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Panel and Workshop n I 

SELECTION FOR TRAINING - DO PRESENT 
PRACTICES MILITATE AGAINST OLDER WORKERS? 



The panel was convened at 2:04 p. Cl Mondsy, January 17, 1966, Dr* Morris S, Viteles* 
Professor of Psychology, Ikiiversiiy of Pennsylvania, presiding; Joseph Seiler, Manpower 
Development Specialist, Office of Manpower Planning, Evaluaticm and Reports, United States 
Department of Labor, as recorder, and Dr. Robert Droege, Research Psychologist, Bureau 
of Occupational Test Development, Ihiited States Employment Service, as resource con- 
sultant. 

DR. VI TELES: Having postponed the meeting from 1:30 to 2:00 o!clock, it seems to me 
that five minutes after 2 ;00 is not too late to begin. 

The problem, as shown on the program, is Selection for Training — - Do Present 
Practices Militate Against Older Workers ? I think that the spirit of die program and its 
ultimate purpose is well stated in a little note recently written by a man in South Africa, 
named Silverbaiier, who is concerned in South Africa, in quite a different context, of course, 
blit in essence with someadiat the same problems with which we are concerned here. And 
he made this very interesting observation: 

*’It is quite an achievement to assess men as they are, but we need to go much further 
and assess vdiat. they may become. " 

And this, I think, is a basic problem in our ^fort to take care of the older, especially 
the displaced older worker. 

We start with a series of four papers, reports, on work that has been done in diis field. 
Immediately after the completi<m of diese reports we will have a workshop discussion which 
it is hoped will 3 rield recommendations that can be applied in. dealing wifli the problem at 
hand. 
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Our first speaker is Dr. Nathaniel J. Pallone who is Coordinator of Counselor Education 
in the Department of Education, Graduate School, at the Universi^ of Notre Dame. As you 
mi^t expect, he is an author and an educator and ever 3 rthing else that goes with being an 
academic man. But I think of interest today is the fact that, from December 1963 to June 
1965, he served as Project Coordinator and Research Director for the South Bend project 
on the Educational Rehabilitation of the Hard Core Dhemployed, 

I have pleasure in presenting Dr, Pallone who will speak to die topic "Ihe Effects of 
an Educational Rehabilitation Program Upon Vocational and Mental Aptitude Test Performance 
of Hard-Core Ihiemploycd Workers. ” ♦ 



(Applause.) 



DR. PALLONE: During 1962 and early 1963, an appreciable proportion of potential 
applicants for MDTA-sponsored vocational training programs operated by the South B«id 
( Indiana Community School Corporatimi were excluded from such programs on the basis 
of their sub-minimal scores on the General Aptitude Test Battery (GATB), virtually 
universally employed as a selecticm device in Federally-sponsored vocational training or 
retraining programs. Further, dieir test performances on the GATB-G ( "Geiieral •) sc e, 
regarded as an IQ-equivalent, displayed levels of intelligence in the sub-normal or even in 
the '*mentally retarded” (i.e., below 70) range. As a group, these workers were primarily, 
but not exclusively, among the hard-core unemployed. 



Since their test performances seemed to indicate lack of ability to profit 
training or retraining, a pathway from economic superfluity to occupational s ab -ty via 
the acquisition of marketable skills seemed closed. However , the GATB essentially 
measures ''developed” rather than pristine abilities, in much the same fashion that a 
scholastic aptitude instrument measures ability to profit from instruction at succeeding 
grade levels or in specific subject areas. For example, the high school student irao as not, 
in his previous educational development, satisfactorily mastered the content of Algebra I 
is unlikely to be "ready to profit from instruction” in Algebra II regardless of the level 

of hi s prlsthie mental ability. 



[ 



The GATB was designed to function as a measuring device among the mainstream of 
American workers, the majority of whom have completed some six to ei^t years of common 
or elementary schooling, and the GATB performs this function well . But it seems reason- 
able to conjecture that subjects markedly deficient in basic education^ ski Is ^even in 
years of exposure to common schooling ot subject to cultural or linguistic handicaps will 
display in their GATB performances levels of "developed” abilities neither consonant 
with ability levels characteristic of the mainstream of American workers nor with the 
level of their own "pristine” but undeveloped mental ability. This observation applies 
especially to the Verbal and Numerical tests on the GATB, but it is likely that even 
success in assembly tasks may be influenced fay deprivation in one* s education K,^q>erience, 
either directly or indirectly, as a function of increased confidence in one's ability to 
manipulate the objects in his «ivironm€mt. In any event, the results reported later tend 



* See Appendix I, Not e No, JLr P6» 
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to argue in that direction. 

A number of workers whose performances disqualified them for entry into MDTA pro- 
grams reported to Employment Service screening interviewers that they had never attended 
school; the majority of others reported that their educational experience had terminated 
below the sixth grade, and many had received whatever schooling they reported in segregated 
schools in the deep South. 

The confluence of questions about the applicability or relevancy of the GATE as an 
appropriate selection device for. this population and the demonstrably poor educational 
backgrounds of the workers in question led the Division of Adult and Vocational Education 
of the South Bend Community School Corporation to request the Office of Manpower, 
Automation, and IVaining to fund a quasi -experimental program designed to prepare hard- 
core unemployed workers to profit from vocational training by improving their basic educa- 
tional skills. In December 1 963, a contract was awarded for a demonstration and research 
project focussed on the educational rehabilitation of hard-core unemployed workers. 

IMder terms of this contract, a group of 100 hard-core unemployed workers whose 
GATE scores disqualified them from vocational training or regaining were to be en- 
rolled for a pmriod not to exceed thirty-six weeks in a pre -vocational program of educational 
skills improvement, focussed on verbal and mathematical or aridimetic skills. Only 
those workers di^nosed as mentally retarded on grounds other than GATB-G scores were 
to be excluded. 

’’Project Edrehab” was operationalized in February 1964 and terminated in October 
1964. Previous reports (Jurkowski and Pallone, 1964; Pallone, 1 965) , published by 
and available from the South Bend Community School Corporation, have described the 
implementation of the project and attendant research results in detail. It is the pur- 
pose of this paper to report Inriefly the effects of an educational rehabilitation pro- 
gram upon the vocational and mental aptitude test performances of Project Edrehab 
enroll ees. 

Social -Vocational Characteristics 



To situate the "typical” Project Edrehab trainee in an appropriate social context, 
it is necessary to review a few elements of social, educational, &nd vocational history. 

( Background characteristics have been reported in detail by Jurkowski and Pallone, 

1964.) Thirty-eight percent of Edrehab enrollees were male Caucasians, forty percent 
male Negroes, and twenty-one percent female Negroes, Althoug^i three female Caucasians 
were enrolled, they were eliminated from research consideration in view of the likeli- 
hood of a typicality, A number of selected enroUee characteristics are tabulated in 
Table 1. 
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Table 1: Selected Social -Vocational Characteristics 



Characteristic 


Male Caucasian 


Mal e Negro 


Female Negro 


Number 


39 


41 


22 


Proportion 


38 % 


40 % 


21 % 


Mean Age in Years 


45.1 


44.5 


31.6 


Years of Formal Education 


7,5 


7.6 


9.1 


Years in Labor Force 


29,2 


28.7 


13.4 


Years of Unemployment 


5.0 


6.3 


2.2 


Number of Jobs ( Tl) Held 


7.9 


14.6 


3.9 


Bom in North Central States 


83% 


12% 


24% 


Bom in South Central States 


7 % 


' f * 

70% 


53% 


Bom in Gulf States 


0 % 


6% 


12 % 


Years of Residence in S. B. 


33.8 


19.2 


13.5 


Left School to Support Parents 


38% 


70% 


24% 


Left School to Support Self 


24% 


3% 


24% 


No Reason to Continue School 


24% 


15 % 


6% 


Intercity Residence Changes 


3.0 


7.7 


3.2 


Educational Age ( Stanford) GL 


3.7 


3.1 


4.6 


Mental Age (CTMM) GL 


4,8 


5„1 


5.6 


Educational Retardation (Months) 


13 


24 


12 


Legend: TT - Technical Term GL - 


Grade Level 





ERIC 
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Of psrticulsr interest to those concerned about manpower development of the over -45 
or ’’older" worker are characteristics reported for male Caucasian and male Negro Edre- 
hab enroliees, wlto reveal strikingly similar profiles while female Negro enroUees 

differ markedly. 

Males of both races, on the average, could be regarded as members of the "older 
worker" group at the time of entry into Proj ect Edrehab. As inspection of Table 1 todlcat es, 
th^ had completed, on the average, seven and one-half years of formal sc oo ing, ha 
spent some 29 years in the labor force, had experienced frequent job (as opposed to mere 
positton) change, and revealed educational achievement levels equivalent to that of to- 
day’s third-graders. However, the "typical" male Negro enroUee had ej^rienced j ob 
change more often, rou^ly every ei^teen months of his working life during periods of 
employment, and shows a demographic concentration in the Southern states. Male Caucas- 
ian enroUees, in contrast, had experienced job change only every thirty-six months of 
their working lives and originated primarily in the Northern states. Simil^ly, male Negro 
trainees had changed their city of residence much more frequently than their Caucasian 
counterparts and had come tc live in the South Bend area much later in life. 

The "typical" female Negro provides a number of similarities and contrasts. Sie is 
considerably younger than her male counterparts of either race and thus has spent less 
time in the labor force. She has also had more formal education and demonstrates a 
higher current level of educational achievement. She resembles the male Caucasian en- 
rollee in that her job changes have occurred roughly every three years of her working life 
during periods of employment; die resembles the male Negro enroUee in demographic 
concentration. 

The final three entries in Table 1 — educational age, mental age, and educational re- 
tardation-demand special comment. An enroUee’s educational age, eiqjressed here in 
terms of grade level in years and months, was calculated from his performance on the 
subtests of the Stanford Achievement Test Battery. Scores on each subtest — treading, 
arithmetic, language uss^e, and spelling— were converted into grade level equivalents 
according to tables provided in the publisher* s manual, summed, and meaned. The re- 
sulting mean was regarded as the subject’ s current educational age. Scores on the 
California Short-Form Test of Mental Maturity were similarly converted into grade level 
equivalents according to standard tables to provide an index of the subject’s current mental 
age in terms comparable to those used to express his educational age. The calculation of 
the subject’ s index of educational retardation required simply the algebraic subtraction 
of his educational age from his mental age. If the resulting algebraic sum were accompanied 
by a positive sign, indicating that the subject’s mental age regardless of the absolute v^ug. 
of that age in tOTms_exceeded his educational age, the subject was regarded as education- 
ally retarded; if the resulting sum were accompanied by a negative sign, the subject was 
regarded as not educationally retarded, but not as necessarily mentally retarded. M- 
terestingly, of die 178 hard-core unemployed workers whose GATB scores rendered them 
ineligible for vocational training referred fo3* pro-enrollment testing to die Project Edrehab 
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staff, only four were fo^'jnd to be not educationally retarded, 

EdrAab enrollees demonstrated educational ages rangine from “ 
chU<fr«^o have completed one month in third grade to that of those vrtio 
six months in fourth grade, wltt> corresponding educational retardation ranj^g “ . 

Even thou^ the mental capacity to profit from instruction 
aklUs ^ipeared, on toe basis of these results, to be quite limited, it was toe tas 
ject Edr^ab to actualize that capacity, 

somewhat extraneously to toe present discussion, « ^fr^S^e 

Of Titolel leads one to speculate whetoer race or sex characteristics wnallv 

in toe and psychosocial djmamlcs underlying hard-core unemido^ent. m y. 

The which em^^s is toe famiUar circular relationsMp be^een 

leaving, frequent horizontal Job changes between ^ .{ snoradic 

airtiia and offering neitoer economic nor psychological security, P®f * ** 

or chronic unemployment, and economic superfluity in an Industrialized society. 

Performances at Twenty V/eeks 

Prior to referral for enrollment, prospective Project Edreh^ traces 

ministered the GATE. Prior to enrollment, as has been mention^ lavement 

the California Short-1 orm Test of Mental Maturity (CTMM) and the^ord Achievment 

Test Battery; in addition, they were given the Revised Beta ^^ination, ^ 

loaded group test of Intellectual functioning developed from the long-revere » 

and the Ammons-Ammons Quick Test (QT) , a clinically-administered, 

"culture-fair" test of Intelligence. Subsequently, at toe termination of twenty and to ty- 

six weeks, respectively, subjects were retested on these measures. 

Subjects whose performances, after twenty weeks of basic educational 
ment to Project Edreheto, on toe GATE had increased to toe level of minimal or 
qualifying scores for a variety of vocational training programs, were ^ * 

enroUees completed an additional sixteen weeks (for a total of onmiiment 

Table 2 summarizes performances on the CTMM, Beta, QT, and CA pr or 
and at the completion of twenty weeks for enrol lees who either entered vocaUonal traix^g 
or terminated "for good causes" (generally, to accept full-time employment situations 
which toey had been referred by toe Edrrfiab staff) at that point. ^ 
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Table 2; Mental and Vocational Aptitude Test Performance After 20 Weeks 







GROUP A: ENTERED VOCATI ONAL TRAI NING 




Male Caucasian 


Male Negro 


Female Negro 




(N 


-8) 


(N - 


9) 


(N 


-8) 




Pre 


20 Wks 


Pre 


20 Wlcii 


Pre 


20 Wks. 


Measure/Score 


California IQ 


57.3 


* 


58.8 


♦ 


66.5 


* 


Beta IQ 


88.5 


100.0 


92.1 


100.9 


83.8 


89.2 


Quick Test IQ 


85.1 


99.3 


71.6 


91.6 


63.4 


87.2 


GATB-V (Verbal) 


72.2 


83.3 


71.8 


79.6 


73.1 


86.0 


GATB-N (Numerical) 


60.6 


81,7 


55.3 


74.7 


61.2 


79.4 


GATB-S (Spatial) 


78.3 


86.6 


68.1 


81.0 


75.2 


84.1 


GATB-P (Form Perception) 


63.0 


73.3 


48.3 


77.2 


63.1 


76.8 


GATB-Q (Clerical Perception) 


72.2 


86.6 


69.9 


87.5 


75.7 


85.3 


GATB-K (Motor Coordination) 


65.7 


77.5 


65.3 


79.4 


84.5 


97.1 


GATB-F (Finger Dexterity) 


67.5 


87.5 


75.6 


83.3 


89.7 


116.8 


GATB-M (Manual Dexterity) 


79.7 


84.3 


83.1 


89.2 


102.8 


106.2 



GROUP B; TERMINATED FOR GOOD CAUSE 





Male Caucasian 
(N-4) 

Pre 20 Wks 


Male Negro Female Negro 

(N-4) (N-4) 

Pre 20 Wks Pre 20 Wks 


California IQ 


69.0 


♦ 


64.0 


* 


54.7 


♦ 


Beta IQ 


90.5 


100.5 


87.1 


89.8 


73.1 


82.5 


Quick Test IQ 


68.0 


85.3 


68.2 


80.4 


64.0 


86.0 


GATB-V (Verbal) 


68.3 


78.3 


69.5 


75.4 


71,0 


77.0 


GATB-N (Numerical) 


69.7 


78.6 


59.7 


70.5 


59. 6 


85.5 


GATB-S (Spatial) 


68.1 


92.0 


66.5 


73.8 


56.3 


68.7 


GATB-P (Form Perception) 


73.4 


82.6 


59.7 


65.5 


56.3 


79.2 


GATB-Q (Clerical Perception) 


71.6 


73.3 


71.3 


84.7 


74.0 


87.5 


GATB-K (Motor Coordination) 


66.6 


71.0 


65.3 


79.4 


73.3 


98.2 


GATB-F (Finger Dexterity) 


70.6 


78.5 


77.6 


95.2 


96.5 


117.0 


GATB-M (Manual Dexterity) 


80.1 


86.5 


99.6 


128.0 


81.9 


93.5 


* Not administered after 20 weeks 



-128- 



What is most immediately arresting in Table 2 is the range of differences in IQ levels 
on the three instruments utiUzed. While initially Edrdieb enrollees earned scores on the 
CTMM ^ch fall weU below the borderline defective range, ttey earn scores on the Bets 
and die QT vhich place them only slightly below normal and well within the ”dull normal * 
range. It is quite evident that die three instruments, while each reliably measuring many 
aspects of intellectual functioning or learning ability, measure quite different aspects. 

The differences reported in Tabl e 2 are sharpened v^en one considers that the three instru- 
ments have quite simUar statistical properties, including similar standard deviation values, 
so that scores are relatively comparable cross -sectionally. A number of Interesting ob- 
servations suggest themselves as one scans Table 2 across sex and race lines. The simil 
arity of mean scores on die Beta and QT for male Caucasians suggests these tests ctmeur- 
rcntly validate diemselves for diese subjects. But, if diis is so for white subjects, how 
does one account for the wide disparity betwe^i mean Beta and QT scores among Negroes 
of either sex? How culturally neutral is a *'culture-fair'' test? 

Further, it i s difficult to suggest that one or another instrument measures die m^tal 
ability levels of hard-core unemployed workers more "accurately" tiian anodier. EarUer 
it has been suggested or at least Implied that a prime characteristic of an instrument which 
mieasures **pristine" ability is its stability, or lack of susceptibility to Influence arising 
from intervening educational, social, or cultural ejQJeriences. Yet the instruments in 
question fluctuate quite widely as a result ft at least as a correlate of the subjects' parti- 
cipation in ba*?ic educational training. In view of dire social consequence attendant upon 
selection of alternative measuring devices, the social service-oriented researcher mi^t be 
tempted to champion that instrument which seems to hold greatest hope for an alienated 
people In a gray world— but he should be aware of die roots of his judgments and be aware- 
too,fbathe is largely pla 3 ring a game with himself. The cold fact of die matter is tiiat one is 
or is not mentally retarded, is or is not vocationally trainable, is or is not an economical!;, 
superfluous iierson not so much on the basis of one's own bdiavior but on die basis of the 
structure of a measuring device. 



Before interpreting the meaning of changes in GATB performances reported in Table 
2, it is necessary to consider some of die statistical (as opposed to structural for that is 
anodier matter) properties displayed by this instrument. The standard deviation value on 
each component test of die GATB is equivalent to 20 scaled score units or "points"; its 
standard error of measurement is rou^ly approximate to six and two -thirds scaled score 
units. That is to say, if one were to test and "Infinitely" retest a subj^t vdiose initial score., 
say, on die V Test, was recorded as 80, one would expect that by chance alone two-diirds 
of die scores recorded for die subject would vary between 73 and 87, and diese fluctuations 
would arise only from the operation of chance factors alone. Similarly, one would ejqiect 
that 98 percent of die time the subject' s scores would vary between 66 and 94 by chance alone. 

It would be impossible to produce elaborate statistical evidence to d-^monstrate that 
the differences in test performance reported in Table 2 are or are not due to die operation 
of chance factors. But it seems to this writer not only unnecessary but perhaps even tragic 
to feel compelled to do so. The fact of die matter is that, prior to dieir exposure to Pro- 
ject Edrehab — and the writer believes that its paramount valn.e was simply die encounter 



o 
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between those who had beai defeated and those who cared— -these hard-core unemployed 
workers had indeed been regarded as unable to profit from vocational training. After their 
exposure, because their performances rose here 7 points, there 19 points, toey were re- 
garded no longer as superfluous people. Whether Project Edrdiab did no more tiian help 
these sul^ects make chance work for fliem by helping them increase their sense of self- 
sufficiency — or rekindling it — ^is not the issue. What is important is toat, in a comply 
industrialized soc. ^fy, decisions are made about people on the basis of, but without reg^ 
o, toe operation of chance. Not toe instruments, but toe selection procegs itself must be 

called into question. 

After tois l<»ig preamble, it is profitable to look at toe ’hard’* evidence contained in 
Table 2. Male Negro enrollees uho completed educational training in 20 weeks and entoed 
vocational training performed in such fashi<m on the readministration of toe GATE that they 
aqipeared to have gained from 8 scaled score points (in verbal iq>titude, finger dexterity, and 
manual dexterity) to 29 (in form perception) , while toeir Caucasian counterparts appmr^ y 
gained from 5 (manual dexterity) to 21 (numerical) . Female Negro enrollees appeared to 
make greater gains, from 6 (manual dexterity) to 18 (numerical aptitude) • Since Rrojw 
Edrdiab’ s instructional program was limited to communication arts and arithmetic ski^, 
it is interesting to note gains reported in perceptual and motor skills, since toese form 
no part of the intervening educational experience. It is evident from Table 2 toat enroll^s 
vtoo elected to terminate for good cause sqipeared to make gains similar to those of enro ees 
vitoo entered vocational training, althou^ toeir initial levels varied somewhat. 

Performances at Thirty-Six Weeks 

Edrehab enrollees who completed toirty-six weeks of educational skills training and 
subsequently entered vocational training were retested after toe completion of twoity and 
toirty-six weeks respectively. These scores are tabulated i" Table 3. 



Table 3: Mental and Vocational Aptitude Test Performance After 36 Weete 





Male Caucasian 


Male Negro 




Female Negro 




(N - 


-12) 




(N-12) 




(N 


-10) 






Rre 


20 Wk 


36 Wk 


Pre 20 Wk 


36 Wk 


Pre 


20 


36 Wk 


Measure/Score 


California IQ 


57.3 


* 


68.3 


47.7 * 


77.1 


67.5 


* 


86.6 


Beta IQ 


81.5 


93.2 


98.4 


84.0 87.1 


92.3 


84.8 


93.8 


95.2 


Quick Test IQ 


82.3 


90.1 


** 


64.7 86.8 


** 


75.0 


86.1 




GATB-V 


71.6 


76.3 


78.4 


65.8 69.7 


81.0 


71.7 


76.8 


79.7 


GATB-N 


58.6 


65.6 


67.6 


50.9 66.4 


67.8 


65.1 


85.1 


89.0 


GA.TB-S 


75.3 


81.1 


85.1 


60.2 66.7 


73.6 


65.4 


81.9 


87.2 


GATB-P 


61.5 


74.5 


78.3 


39.6 56.8 


66.1 


71.4 


89.3 


93.4 


GATB-Q 


71.9 


74.5 


79,4 


64.8 69.7 


78.0 


80.9 


90.6 


93.3 


GATB-K 


67.8 


69.1 


73.6 


52.2 57.1 


72.7 


81.7 


100.7 


105.6 


GATB-F 


67.8 


70.1 


82.3 


55:. 6 67.5 


7S.4 


85.6 


104.2 


112.3 


GATB-fl 


71.7 


81.3 


SI. 3 


63.2 70.8 


76.3 


S8.7 


101.9 


120.1 


* Not administered after 20 weoks 


♦♦ Not administered after 36 weeks 
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Inspectibn of Table 3 suggests flie following consider atiocs: (1) Performances on Ifae 
three measures of mental ability emidoyed fluctuate considerably in associatioa with in- 
creased eoqx>sure to an educational rehabilitation program. (2) In general^ the greatest 
gains in vocatianal i^tude test performimce appear to occur after 20 weeks of educati o nal 
skins improvement, at which point a idateau or point of saturation is observable, especially 
in aptitude areas related to die instructional program, ihoui^ increments are observed in 
perceptual and motor skills. 

Summary 

Tiis paper has reviewed certain effects of an educatlcnal rehabilitation program upon 
the stability of vocational and mental ^xtitude test performance of hard-core unemjdoyed 
workers showed evidence of educational retardation. 

Specifically, it has been r^rted that 

1. Male Caucasian enroUees who entered vocational training after 20 weeks in Edrehab 
demonstrated apparent incremoits of 12 score units <m the Beta, 14 on the Quick Test, 10 in 
verbal aptitude as measured by die GATB, 21 in numerical, 8 in spatial, 10 in form percep- 
ti<m, 14 in clerical perception, 12 in motor coordination, 20 in finger dexterity, and 5 in 
manual dexterity. 

2. Male Negro enroUees vdio entered vocational traming after 20 weeks demonstrated 
apparent increments of 8 score units on the Beta, 20 on the Quick Test, 8 in verbal sqptitude, 

19 in numerical, 13 in spatial, 29 in form perception, 18 in clerical perception, 14 in motor 
coordination, 8 in finger dexterity, and 8 in manual dexterity. 

3. Female Negro enroUees in this group showed apparent increments of 6 on the Beta, 

14 on die Quick Tes^ 13 in verbal, 18 in numerical, 9 in spatial, 13 in form perception, 10 

in clerical perception, 13 in motor coordination, 17 in finger dexterity, and 6 in manual 
dexterity. 

4. Male Caucasian subjects viho terminated for good cause after 20 weeks of educational 
training but before entering vocational training showed sqpparent increases of 10 on the Beta, 

17 on the QT, 10 in vmrbal, 9 in numerical, 24 in spatial, 9 in form perception, 2 in motor 
coordinatiem, 5 in clerical perception, 8 in finger dexterity, and 6 in inanual dexterity. 

5. Male Negro subjects in this group showed increases of 2 on the Beta, 12 on the CT, 

6 in verbal, U in numerical, 7 in spatial, 6 in form perception, 13 in clerical perception, 14 
in motor coordination, 18 in finger dexterity, and 29 in manual dexterity. 

6. Female Negro subjects in this group demonstrate apparent gains of 9 on the Beta, 

17 on the QT, 6 in verbal, 26 in numerical, 12 in spatial perception, 23 in form perception, 

13 in clerical perception, 25 in motor coordination, 21 in finger dexterity, and 12 in manual 
dexterity. 
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7« Among Edrehab trainees who completed a full thirty-six week of x Jiabilitative 
educational training, male Caucasian subjects demonstrate apparent increments, after 20 
and 36 weeks respectively, of 2 and 8 on the Beta, 28 on the QT and 11 on tiie CIMM, 5 and 7 
in verbal, 7 and 9 in numerical, 6 and 10 in spatial, 13 and 17 in form perception, 3 and 8 
in clerical perception, 5 and 6 in motor coordination, 12 and 15 in finger dexterity, and 7 and 
20 in manual dexterity, 

8. Their male Negro counterparts demonstrate, after 20 and 36 weeks respectively, 
increments of 3 and 8 on the Beta, 22 on tiie QT and 30 on the CIMM, 5 and 16 in verbal, 

16 and 17 in numerical, 6 and 13 in spatial, 17 and 27 in form perception, 5 and 14 in clerical 
perception, 5 and 20 in motor coordination, 12 and 24 in finger dexterity, and 7 and 23 in 
manual dexterity. 

9. Their female Negro counterparts demonstrate, after 20 and 36 weeks respectively, 
increments of 9 and 11 on the Beta, 11 on the QT and 19 on the CTMM, 5 and 8 in verbal, 20 
and 24 in numerical, 15 and 22 in spatial, 17 and 22 in form perception, 10 and 13 in clerical 
perception, 20 and 20 in motor coordination, 19 and 24 in finger dexterity, and 3 and 8 in 
manual dexterity. 

The results reported suggest that: 

1. hi general, scores on the Beta appear more stable as indicators of mental ability 
among educationally-retarded workers than scores on either tiie CTMM or the QT. Stability 
of Beta scores seems to indicate that the instrument represent a clos^ approximation to 
measurement of "prinstine" ability, since performances seem less affected by intervening 
learning experiences. The CTMM and QT appear more susceptible to change in the form of 
greater increments following intervening learning experiences. These considerations seem 
to argue in favor of adoption of the Beta as a device to measure mental ability among educa- 
tionally-retarded workers. 

2. Generally, hi^er initial performances on mental ability measures are associated 
with smaller increments. This observation suggests a stabilizing of mental ability scores 
Once a point of saturation has been reached, above or beyond which increasin^y smaller in- 
crements are likely. 

3. hi general, initial performance levels on the GATB in verbal aptitude are more 
resistant to change than are initial levels in numerical aptitude or in perceptual -motor skills. 

4. G^erally, hi^.cr initial levels of performance in vocational aptitudes are associ- 
ated with greater apparent increments. 

5. Dramatic increments in perceptual -motor skills are observable, even fhou^ these 
skills are not focal points for instruction in an educational rehabilitation program. 

6. Mstructional experiences in basic educational slcills extending over twenty or fliirty- 
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Six weeks are associated with mar ked increases in inventoried mental and vocational aptitude 
sufficiently large to gain entry for workers into vocational training or retraining programs. 

SimUarly, instructional experiences were associated with compensation for ^cational 
deficiency of from one to three years. More severely educationally retarded enrollees 
peared to need a longer period of compensatory educational experience. 

DR, VITELES; Thank you very much, Mr. Pallone. 

Our next speaker is Mr. Droege who has a Master’s degree in 
University of North Carolina and is currently a psychologist with the U.S. 

Service and has, indeed, worked In the area of test research with the U. S. Employme 
Service and the Department of the Army for 13 years. 

Mr. Droege is going to speak on ’’Current Research in Test Development. 



Mr. Droege, 



MR. DROEGE; The average age of the nation's labor force continues to incr^e, 
and growing numbers of older workers are being involuntarily retired or tcchnologicaL j 
displaced and compeUed to look for other jobs late in their working lives. Mmiy of 
those who need help 1 n f inding suIUble new employment wil 1 not be able to °MaM )o f 
closely related to those they had previously. To what extent can testmg help ^vermlne 
what o&er occupations these older persons can leam and perform success y 



The USES has recognized that there are special problems in obtaining valid m 
meaningful measurements of j ob potential of older individuals. Some of the pro ems 

are diese: 



1. Most research to develop aptitude tests for use in selection and counselmg 
has been done with young people. Are these tests useful also with older workers . 

2. Many older job applicants or training candidates have little education and 

test taking experience. VVhat special techniques are required to overcome this handier . 



3. Number of years of formal education is an inadequate indication of achievement 
level of an older person. But currently available tests of basic reading and arithmetic 
skills have disadvantages when used with ol der persons. How can these disadvant^es e 

overcome V 



Tbe U.S. Employment Service has undertaken a program of research in these areas. 
Some projects under this program have been completed some are in progress, and others 

are being planned. 



Applicability of Aptitude Tests to Older Workers 
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The Employment Service uses the USES General Aptitude Test Battery (GATE) to 
obtain measures of occupational aptitude. The GATB consists of 9 ^titudes measured by 
12 tests. The 9 aptitudes are G-General Learning Ability, V-Verbal Aptitude, N-Numerical 
Aptitude, S-Spatial Aptitude, P-Form Perception, Q-Clerical Perception, K-Motor 
Coordnatlon, F-Finger Dexterity, and M-Manual Dexterity. The GATB was published 5n 
1947. Since that time, we have accumulated a vast amount of standardization data on tiie 
GATB, so that it is now generally regarded as the best validated aptitude test battery in 
existence for use in vocational guidance. 

Since most of this research has been done using samples of younger workers, a 
question arises as to the applicability of the tests for older persons. 

1. Completed Research 

We have completed some research showing the relationship between aptitudes and 
age for adults,. Two different studies were conducted, one in New York and the other in 
four States—- California, Pennsylvania, Iowa and Attchigan. The New Yoik sample consisted 
of 1,476 individuals. The four-State sample consisted of 2,439 individuals. The design for 
the four-state stu<ty was similar to that for the New York stu^y ♦ The chief difference in the 
designs was in the type of control on education. In the New York stu^ the individuals in 
each age interval had the same percentage distribution of years of education; in the four- 
State stucty each individuai in the sample had the same number of years of education (12 years) . 

In general, the pattern of relationship between age and average aptitude scores 
is similar in the two studies. (I can provide details of these findings, on request.) Inspec- 
tion of the age curves shows tiiat all aptitudes, except Verbal Aptitude, show some decline in 
average scores with age. However, the decline is not large for General Learning Ability 
and Numerical Aptitude. The largest declines (up to 40 points from age 17 to 72) were 
obtained for Form Perception, Finger Dexterity and Manual Dexterity. Declines of about 
20 points from age 17 to age 72 were obtained for Spatial Aptitude, Clerical Aptitude and 
Motor Coordination. 

There is variation among the aptitudes with regard to age of onset of decline. 

General Learning Ability and Numerical aptitude show no decline until about age 47. 

Clerical Perception, Motor Coordination, Finger Dexterity and Manual Dexterity show little 
or no decline until about age 32. Spatial Aptitude and Form Perception start declining 
before age 20. After the age of onset, the decline with age is approximately linear. 

Note that any interpretation of the results of the age curve studies must be in terms 
of averages. Since individual differmices in rates of change of aptitude scores with age are 
likely to be substantial, age curves for many individuals may differ considerably from 
curves based on average scores. 

2. Research in Progres s 

Availability of reasonably good age curve da,ta for GATB aptitudes makes possible 
the development <rf age norms for the aptitudes. That is, obtained scores can be adjusted so 
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tl\at the average adjusted ^titude score is the same throu^out the age range. Since there 
is a marked decline in obtained scores with age on most of the aptitudes, the correspondmg 
adjustments would be substantiux for older individuals. The question of the desirabi ty o 
making such adjustments to develop age norms for intelligence and aptitude tests is an old 
one which has not been resolved. One basis for deciding between unadjusted and age- 
adjusted aptitude scores lies in comparison of the relative validity of die two sets of scores 
in prediction of performance for appropriate occupational samples. Research is in progress 
to determine the validity of age adjustments for aptitudes in prediction of job performance. 



Prelr-inary data from 11 longitudinal studies on specific occupations of widely 
varying requirements and skill levels indicate that, in most instances, unadjusted and age- 
adjusted aptitude scores do not differ api-veciably in how well they predict training success 

or early job success. 



With reference to the occupations included in this investigation, age adjustments 
in the aptitude scores resulted in substantially better prediction for only one occupation, but 
such adjustments resulted in substantially worse prediction for two occupations* For e 
remaining eight occupations the differences between age-adjusted and unadjusted score 
prediction were quite small. 



3 R0S03Tch Pl£um0d 

The investigation on effect of SLge adjustments was limited to comparisons of 
validity coefficients of unadjusted and ^e -adjusted aptitude scores. We plan an addition 
stuc^ (on the same 11 samples) focusing on the Individuals who fail established aptitude 
cutting scores for specific occupations when unadjusted scores are used but pass the same 
cutting scores vAien. i^e -adjusted scores are used. Analyses will be done to determine 
whetiier these workers who shift from a fail to a pass category on the tests are more e 
successhil workers or unsuccesshil workers. 



Development of Appropriate Testing Tools and Techiques for E d ucationally Deficien t^ 
Individuals 

Recently the emphasis in our occupational test development work has changed because 
of increasing interest in serving educationally dificient individuals. Since many of the hard- 
core unemployed do not have sufficient literacy skills to take all of the GAT3 teste, we have 
undertaken a number of research projects to develop tools for use with these individuals, 
many of vhom are older workers. 

1. Research Completed 

One of the problems in testing persons with limited education is determing whether 
the GATB would be a fair measure of their aptitudes, hi the past, many of these individuals 
have been included in group testing sessions for the GATB without such a determination. 

The result has been that low scores were not meaningful, because there was no way of 
knowing whether they were a reflection of limited ability, inadequate reading ability, or 
cultural limitations to perform adequately on the tests. 




-135- 



For ttiis reason, we undertook the development of a short, objective, easily 
scored screening device to determine the ability of individuals to take the GATE. The device 
was developed from the practice items for the GATE tests. Eight State agencies p^ticipated 
in the study. More than 800 persons with 8 or fewer years of education were tested. 

Results of the study led to the development of a screening device, which consists 
of three-dimensional space a d vocabulary items. 



2. Research in Progress r'Ao'-p 

We have undertaken research to develop a nonreading edition of all nine GATE 

aptitudes which can be administered to persons vdio are lacking in the basic literacy skills 

required to take the regular edition of the GATE, 



In our work on the new USES nonreading tests, we are making every effort to 
develop a more suitable method of administration for use with educationally deficient 
individuals. The directions will be simplified and the format of the tests will have a unique 
feature. The pictures, forms, and diagrams will be printed directly on a machine- 
scorable answer sheet. The applicant will be able to make his marks in the appropria e 
places on the answer sheet even if he cannot read or write. 



Fourteen experimental USES tests are being set up in this format. Each of these 
ha-s been tried out with poorly educated individuals to get information on admMstration 
problems and score and time distributions. These tests are now being inclu e to 
scale studies to determine their usefulness for measuring the aptitudes of the educationally 

deficient individuals for whom the GATE is insqipropriate. 



3. Resear r ! Planned 

We plan to conduct a variety of studies on techniques of test admmistr ation t 
uneducated individuals, studies on prediction of success in training (both basic literacy 
skills and vocational training) and prediction of success on the job, using a variety of tests 
as experimental predictors. 



Development of Achievement Test of Basic Literacy Skills 

Tools are also needed to assess achievement level to bai c reading and aritlimetic 

skills. The commercially available tests have a number of disadvant^es: They are too 

long; the items are not completely suitable for adulte; and no ^ 

avsdlable to permit evaluating the scores in terms of degrees of basic skills required by 

various occupations. We are now negotiating a contract with a university for the construc- 
tion of suitable achievement test items. After this phase has been completed, we wil 
solicit the cooperation of State Employment Services to conducting the necessary standar 

ization on experimental samples. 



Summary 

In summary, the USES has (1) recognized the need for valid measurement of 



o 



-136 - 



occupational potential of older persons, (2) identified problem areas of measurement arid 
(3) undertaken an aggressive program of research to work toward solutions. Certariily more 
could be done, but our resources are limited and must be applied to other problems as well. 

It should be recognized that there is an alternative to a solid, but time-consummg, 
research effort. The alternative is to arrive at quick solutions to complex problems of 
testing on the basis of analysis of inadequate data or on the basis of superficial considera- 
tions. Particularly in these days of rapidly evolving programs for youdi, older workers, 
the disadvantaged, etc., tiiere is areal danger tiiat the quick solution to hard problems will 
take the place of the solid research that is required. 

One final word. As the tec>ts and measurement techniques become more refined and 
appropriate for the purposes intended, we cannot assume that they become less sulq^ct to 
misuse. Qualified coimselors sensitive to the needs of the client will always be needed if 
the tests are to be properly used. 

DR. VITELES: Thank you very much. 

Our next speaker is Dr, Kennedi Carl who took his degree in education at the 
Pennsylvania State University in 1959, who has had suitable tr ainin g and both in 

education and in dealing with problems of training workers and who is currently President 
of the Williamsport Area Community College. 

Di‘. Carl will spealt on "Vocational Diagnosis vs. Simple Testing Programs for 
Selection and Orientation of Training for Older Workers." 

DR. CARL: Thanlc you, Mr. Chairman. Ladies and gartlemen. Iwanttomalre 
sure that you understand that I am interested in a selection of, and the orientation to, the 
best possible occupational choice for the training of the individual unemployed older 
worker, I care net that you have 30 training stations available to unemployed older 
workers to learn to be sewing machine operators and that you have reasonable assurance 
that those persons who satisfactorily complete their training will be employed, at X 
company at $1 . 75 per hour to start. 

I am afraid that most of our training of unemployed adults has been job-oriented 
rather than person-oriented, or job-engineered, if you prefer. I do not believe we have 
solved the long-range unemployment problems of most of those persons who have received 
training or retraining under ARA or MDTA when this training was based on this job- 
oriented philosophy. This is certainly true of the hard-to-reach, hard-to-teach group. 

Or look at it another way. We are essentially saying to the unemployed, "We will 
provide training for you to 1 earn to be a sewing machine operator at no e^^ense to you. In- 
fact, we will pay you at the rvate of the regular unemployment compensation for as long as 
the training lasts — up to one year — if you are the head of a household. We have 
assurance from X Company that they will have employment for you when the training is 
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completed. To qualify for training, it is necessary that you show you have at least the 
minimal aptitude for this kind of work by taking our tests" usually the GATB. 

So what do I do as an unemployed older worker ? If I am really up against it and my 
unemployment compensation is about to run out, I take tlie tests, and the training, and the 
job. But I get out of this rat race as soon as possible because I want to be an auto-body 
repairman. 

This land of counseling hasn't solved any problems except that a training referral has 
compl eted his training and accepted a j ob which was held for a certain length of time — and 
so statistically, it has been successful. 

It is interesting to note that the November 10, 1965, report of the National Council 
on the Aging project in Boston states: 

"Earlier in the Pioject, there was a strong tendency for us to lead the applicant 
into jobs which the Project had previously developed. — Most of the time, the 
applicant would not be sold on the jobs developed so that a large number of jobs 
were never utilized. — The process had to be reversed. Job counseling, first 
and then job development based on the applicant's interests and abilities. " 

Another related fact we must consider is how many jpeople are suffering from the 
consequences of a practical type of job counseling. As counsellors, we attempt to point out 
to the individual where he can realistically go in the job market according to the experiences 
that we have had, 

’ c’lii vocational high school v-duate. And my vocational training v/as in mechanical 
vtcrft in high schemed. Upon graduation from higji school, I was employed as a drafts- 
mm. After one year of industrial experience at that occupation, I was laid off in September 
1932, in the midst of the Depression, If I had come to you as a counselor at that time for 
help, what would you have counseled me to do — a vocational hi^ school graduate ? Would 
any one of you have thou^t that I could have become a college president ? 

As counsellors, we are prone to think of local jobs and jobs as we know them in our 
limited experience. We must thinlc today of national needs and markets in counseling witli 
people, for their potential far exceeds the limited local opportunities in the occupational 
world. The new edition of our "bible" ~ the long awaited revision of The Dictionary of 
CX:cupational Titles will soon be in our hands and will list for us some 39, 000 occupations. 
The problem then will be the same one we have today — in which area do my talents lie and 
how do I get there ? 

To properly counsel each individual as to his vocational potential and help him plot 
the path to this potential from where he now is involves an extensive guidance and counsel- 
ing program which we have called for want of a better name "Vocational Diagnosis." We 
developed this program in 1951 in an attempt to help several hundred members of the United 
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Mine Workers of America, disabled miners of all ages who could no longer return to their 
jobs in the mines because of severe disabilities. Disabilities such as silicosis, miners* 
asthma, heart conditions, broken ba^ks, loss of limbs, eyesight, hearing, all were common, 
as was a third-to eighth -grade education. And the ages ranged from 30 to 60. I recall one 
even at 65. 

We had as many as 70 of such clients enrolled in either vocational diagnosis or full- 
time training at one time, in addition to all of our other students. In addition, some of the 
clients were undergoing physical therapy at the local hospital after school hours in order 
for them to regain the use of their injured limbs. 

I assure you that a few psychological tests, as contained in the usual test battery such 
as the GATB, are not enou^ for this group. 



As you can imagine, v.e realized that in order to make a proper vocational diagnosis 
of the individual, we certainly must know his piiysical condition and any physical limitations. 
We, therefore, need a physical examination of the individual to particularly learn of any 
physical limitations which would a£[ect his occupational choice. Those diseases which are 
not evident on the surface, such as a heart condition, lungs, epilepsy and many others, 
cause us many problems in counseling if we are unaware of their limitations on the in- 
dividual. We should Imow any medical or physical history the clieit has had. The M.D. , 
of course, cannot tell us what occupations are best for the client, because he does not know 
occupations, nor should he be expected to. But we do need &om him any limitations in 
walking, standing, lifting, stooping, sitting, hearing, sight, environmental conditions, such 
as warm and cold, allergies to dust or oils or other materials, and so forth. As we become 
older, we acquire such physical limitations which must be considered. 

Our present program of voational diagnosis is of three weeks' duration. The staff 
consists of a competent psychologist and two qualified vocational counselors who have their 
Master's degrees in Rehabilitation Counseling. We admit an avers^e of 25 clients to each 
three-week session. The first week is spent in getting to Imow the individual and helping to 
motivate him and assure him that he can succeed. His group tours the College, sees the 
shops and labs and the 44 courses that are available to him at this school which do not 
require a four -year college degree for graduation. Each department head explains the 
opportunities available in his department, the working conditions, wages, new advances 
being made in the industry, and die number of different jobs available to perso ns with this 
training, such as the machine shop where we may have as many as 500 different jobs 
awaiting the trainees. Many are occupations that the client had only heard about but had 
no understanding of. 

It would be nice if we had a few simple tests that could be given to an individual to 
determine which one of the 39, 000 different jobs would be the one for that particular in- 
dividual. But, unfortunately, it is not this simple and probably never will be. 

We administer testing involving all the usual aptitude, interest, intelligence. 
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comprehension, de:»terity and visual acuity tests which are given under the supervision of a 
competent psychologist who must determine if the tests have any validity considering the 
physical condition of the individual. If not, other types of individual tests must be pre- 
scribed in an attempt to learn the capacity of the individual. In some cases where either the 
M.D, or the psychologist may discover a mental problem, the client would also be referred 
to a psychiatrist for his evaluation. If serious, all other counseling stops until this problem 
is removed or brought under control by the psychiatrist. 

Upon completion of the physical and psychological evaluation and the 5:our of the 
College, we are ready for a job trial situation lasting for approximately three days in each 
of several occupational areas which were shown by the testing and the physical evaluation 
to be the ones best for the particular individual. We allow the client to pick the first one to 
be tried, providing it is within his physical limitations. Our counselors and psychologist 
suggest and insist, if necessary, that he also try others in which he has a reasonable chance 
of success so that he has at least tried three and possibly four different occupational areas. 

His instruction in each area has been de.pigned to challenge him, and we can measure 
his aptitude and interest in the area by evaluating how well he has done in this work, 
compared witii others who had previously taken the work and gone on and succeeded, 

]h some cases, the client expresses interest or the tests indicate aptitude in an area 
in which we do not offer instruction or work trials in our school, Arran£;einents are then 
made to have the client visit and spend a few days in this occupational area in the communify: 
such as die local hospital if he would be interested in becoming an X-ray technician, which 
we do not presently teach,. 

The last day of the three -week program is spent in an evaluation and determination of 
the future plan for each individual. This is done by a committee composed of the psycholo 
gist, counselors, the doctor, a representative of the State Bureau of Rehabilitation, a 
representative of the State Employment Office, a representative from any other group ^ 
sponsoring the student, such as the VA, or parent, or UMWA, and so on, plus the heads of 
the departments or areas in which the client tried the miniature work situations or job 
trials. This committee discusses the client and his whole history — work, education, 
physical, psychological, marital status, et cetera, and reviews his work and die ccunselmg 
done in the program. When a conclusion has been reached by the group, the client is 
brought in, and he is asked what he has decided he would lilce to do now. hi most cases the 
client has already made up his mind, and the group concurs and offers him encouragement 
toward his new goal. Many times it is in an area he never loiew existed before he entered 
this vocational diagnostic program. Once the occupational area has been oetermined, it 
is then fairly simple to find a training situation for him. 

To date, 3, 621 adults have completed our vocational diagnostic program. Approxi- 
mately 10 per cent have been 40 years of age or older. Lately, the average age has been 
younger. Primarily, tliey are high school dropouts and young high school graduates who 
are confused and do not Imow what tliey want to be or do. A few are college drop-outs or 
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flunl;-outs. Over one-half of the total number we have had are physically handicapped. 

We have probably not kept rdl of the statistics we should have on (his program, and 
some ly X shlld a full follow-up shady. The closest estimate we »ave fr^^rmdm 
checks would indicate that this program has helped at least 90 per cent of ne die , 

K anyone wishes to try this program h, his community, be sure you have » considerable 
number of shoos, labs and courses available ihat are weU equippeo to 
.vith a wide range of aptitude, skill and comprehension, (tos 

and tile setting up throng and including data processing, tape control and all of ttiis s it 
of thing, into tool making, tool design, electronics, et cetera. 

’ should maition the MDTA program. We wonder at the fact that it is re^r ^ ^ ttie 
(Secretory of Labor to fte Congress that 10,9 per cent of the trainees undw toe Manpoww 
XvdSent and Training Act were 45 years of age and over We 
Significant number of older unemployed workers. It is a most sigmficimt 
think of the percentage of unemployed older workers to total unmpl^ed . ^ 
and of toe fact toat the older toe group, toe less general basic educ^on and 
physical and mental handier in toe group. It is surprising to me to^ even this percentage 
survived fte GATB tests to gain admission to fte training program. It “even 
significant vtoen we think of toe limited training opportunities toat have been op«i to them. 

At toe present time we have approximately 50 MDTA trainees in our college out of a 
total fa” -time enrollment of 1, 413 students. We are operating three MDTA " 

surgical technician, bench carpentry, and woodworking machme operator. The MDTA 
trainees ttoo complete their training are all going to work. 

We do not plan to offer any more full-time MDTA braining courses, th^ is, courses 
which are only o^ to MDTA trainees. We wlU now accept MDTA trainees m every coimse 
Tofiron an inMal referral basis. They must meet toe same entraps «^equmemente 
for fte particular course as any other student in that particular course. 
to toe same standards. We bcUeve toat this will provide many more op^rtumfaes for i -DTA 
trainees to prepare for toe occupation they desire and have toe ^ 

only three courses open to them, toey now have 44, which should help to of the 

individual dlfierences in this group. Thus, our MDTA training program will become person- 

oriented radier dien job-oriented, 

1 wish Bernard Ulrich had included vocational diagnosis as a part of toe sto^ that 
he mentioned (his morning, 1 feel toat fte systems approach needs a i^ational diagnostic 
prog, am ivlto job trials added to it. Six hundred hours of prevocational trammg is quite a 

lot for most older workers. 

Thanlc you, 

DR. VITEIES: Ihanl^ you. 



o 
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I believe it is time that the Employment Service and other agencies connected with the 
manpower program become oriented toward the individual who seeks our service rather 
than towards a job or an employer. And tiiis is the philosophy we have tried to move to in 
our Emploinnent Service operations in our small State in the Western mountains. 

I Gsplored widi some of our counselors and our selection officers in MDTA how we 
accomplished this record. And this is what they told me: 

They took an interest in the applicants v^o had application cards in our file. They 
reviewed them. They called them in. They talked to the individuals. They became 
acquainted with them. And they attempted to design a plan of service to fit the individual s 
needs. 

Sometimes the applicants would be called in in groups. Iftifortunately, in these groups 
they do not mix die sexes, but the groups otherwise are heterogeneous rather than homo- 
geneous — that is, of different social, cultural, ethnic backgrounds. The educational 
attainment ranges from no schooling to college graduates. Our counselors have group dis- 
cussions with the individuals to motivate them. And I believe that this is one of the keys to 
our service to the individual — the attitude of our staff, the attitude of the community, and 
toe motivation toat is provided to the worker. 

This is not toe complete story. I would I’ke to talk about something else. But before 
I leave attitude and motivation, the local employment office reflects toe attitude of the 
community toward toe employment of any group, vtoetoer it is a minority group, toe older 
workers, youth, toe unemplo3nnent compensation claimant or any other person, "^e ocal 
emplo3mient office attempts to interpret toe feelings of the business community an toe 
feelings of the labor community in their operations. Cur instructions, on se ection o 
trainees, are to select for the projects we propose trainees who have a reasonable ch^ce 
of obtaining employment. And if selection is job-oriented, instead of ori^ted to indivi al 
needs, I believe that we do discriminate against the older person. Certainly, the use o 
tests as toe sole criterion for the inclusion of a trainee in a program would lead to serious 
disservice to many of our applicants in all age groups. I don’t believe this tells toe whole 

story. 



I divided our trainees into toree groups and made an analysis of tae data. I 
separated out toe data for our three very good special youth projects. I separated out toe 
data for another group toat I will talk about, in a. minute. And the remainder fell just about 
on toe national average in the proportion of older workers to the rest of toe workers in our 

training program. 

Now I would Itoe to talk about toe second "separated-out" group. Here, I believe, we 
find our answer to our puzzle. We also find something that can be exploited in serving toe 

older worker. 

Several years ago, we realized that toere was a rapidly changing technology in the 
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constructioii industry. vV© ninde an intensive stu(fy in construction in Utah and in the 
jurisdiction of Building Trades Councils which lap over our State lines in some instances. 

We found that there were a number of construction workers who were rapidly becoming 
technologically obsolete, Iheir periods of unemployment were becoming more frequent, and 
the duration of dieir unemployment was becoming longer. 

The construction industry was concerned about flie lack of qualified tradesmen for 
that industry. They were trying to get dieir apprenticeship programs enlarged to meet the 
shortage of stalled workers. The construction unions were concerned about their 
not being employed full time. And they were concerned about the apparent lack of skilled 
construetion workers vdio could be used ly employers. 

I proposed to the construction industry, both management and labor, that we tal^e &e 
individuals who had become or were rapidly becoming technologically obsolete and provi e 
them with upgrading training. And the first three MDTA projects in Utah were of this type. 

We selected from tiie construction trades, along with management and the umons, 
those persons who had become technologically obsolete as evidenced by their lac.>. of emp oy 
ment during a relatively hi^ construction period. We desi^ied a training program, ong 
with Vocational Education and with the advice of the construction industry and the r 
unions. We sent these men to school. 

V/e started with carpenters. And just as soon as the other construction trades found 
out what we had done for carpenters, they were in pounding my desk. The business agen s 
wanted tiie same brealc for dieir members. They were complaining that we were dis- 
criminating against them in favor of the carpenters. 

We set up a training program for the structural steel workers, one for the iron 
workers, one for the sheetmetal workers, and then something happened. I was orme 
that the hitemationals of some of the unions did not want to get involved in this program. 
Perhaps that is ri^t; I do not know. This I do know. We have had several very success 
upgrading training programs for carpenters and steel workers, and these unions ^ ® 
us to repeat these upgrading training programs several times. And, just through © 
nature of things, if you talce a skilled construction worker, a person who has wor la e 
construction trades for a long time, who has become technologically obso.ete, he is un 

to be over 45 years of Bge or very close to it. Most important, tiiis is a preventive 
approach rather than a cure of long-term unemploymmt. The early identification of 
workers who are becoming occupationally obsolete, the providing of these worKcrs ^ 
eidier up-grading training or retraining before they become unemployed, is a positive 
rather than a passive program in solving some of our unemployment problems. 

And now. Dr. Viteles, I have talked for IS minutes. I am going to quit. 



o 



DR. VITELES; Thanlc you. 
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Well, I think you all recognize that we have been exposed to a number of most 
stimulating ideas with respect to dealing with the problem of selecting older workers for 
training. We are now rea^ to proceed into die workshop. The problem of malcing use of 
what has been presented involves serious consideration on the part of the people who are 
out on the front lines dealing with problems of the older worker. And it is, of course, the 
group sitting here now which can most readily and most effectively come up with the 
practical recommendations. 

We are going to discuss the selection of the older worker. It seems to me, we ou^t 
to start by defining what we mean by the older worker. At a caucus held at noon, it was 
agreed diat we ou^t to think of the older worker as the man at least 45 years of age or 
older. Perhaps we can also think of the man betv/een 40 and 45, but certainly not 3 rounger 
than 40. 

There is a practical reason for doing so since industry explains its unwillingness to 
hire older workers very frequently on the grounds that the pension schemes which operate 
in most plants require 20 or 25 years of service. And the industry is not in a position to 
hire a man at age 35 or 40 and turn him out without a pension at the end of that time. And 
the industry is unable to give him a pension because of the rules which govern the allotment 
of pensions. 

So 40 to 45 — and especially the latter age — seems to be a pretty good figure with 
which to start around vdiich to center our discussion. 

For women — if we are going to discuss women — it seems to me we mi^t reduce 
the concept of "older" to about age 35 because, again, women are permitted to retire at 
age 55 or 60 as compared with 60 or 65 in the case of men. And also, because the pre- 
judices which exist in industry with respect to the hiring of so-called older people mal^e an 
impact at an earlier age in the case of women. 

At my age, it is very difficult for me to conceive of anybody 35 or 40 or 45 years of 
age being old. But, nevertheless, this is the context in vdiich we are working. And I 
suggest that we limit ourselves to the discussion of these groups. 

Our mission is to come up with recommendations. And I would suggest, in order to 
start this discussion, that we think of recommendations tiiat involve a statement of a aeries 
of principles governing the selection of the older worker for training and that these 
principles apply to action, development and research, these being, in fact, the three areas 
about which we heard from our spealters today. 

By "action", I mean something that on the basis of v*at we Imow with some degree 
of certainty can be done now. 

By "research", I mean those problems which need considerably more intensive and 
prolonged investigation, that need to be solved before we can come up with an action principle. 




By "development”, I mean the gray area in between, the land of research that was 
briefly referred to by Dr. Droege, the approach which involves malting use of data that are 
already available, facts which are already present in incomplete form, but offering the 
opportunity for a kind of sophisticated guess as to what should be the best course of action 
for the moment, pending a better resolution of the problem tnrough research. 

Does this seem to be a reasonable frame of reference for this workshop ? 

All ri^t, the floor is yours. By "yours", I mean anybody. Who wants to start? 

And please, as you get up, give your name and your association — die organization 
which you represent. And do it each time, because we can't e:iq)ect the young woman who is 
doing the stcnotyping to remember who you are and where you are from. 

DR. FEANIC FAHEY ( Director, Center for Community Analysis, University of Notre 
Dame, South Bend, Ind.): I am somevdiat concerned or would lilte to have a little 

more information if at id possible. There has been talk about not getting the job set up 
first then setting up a training program and getting so many bodies to go into this training 
program, but rather to express concern for the individual and to find out what he wants to 
do, what he is capable of doing, and then organizing a training program about these facts. 
Well, if no jobs would then be available, I thinlc that this is perhaps an unrealistic approach. 
And specifically to Dr. Carl who it appears has been doing this type of thing, I would like 
to ask the question: How many of the trainees that you have get jobs in the areas for which 
they have been trained ? 

DR. CARL: Approximately 100 per cent. We have a full-time placement office. We 
feel it is our responsibility to place every one of our students. 

Of course, on the MDTA referrals, it is the responsibility of the Ctate Employment 
Service. And we as a public school may do nothing in placement of these students and must 
refer the students back to the State Employment Service for placement. 

Our shop instructors must have had at least six years in the industry. Some of them 
have 20 years m tool maldng and grinding, ct cetera, et cetera. They know the supervisors 
in industry by first name. Tliey worked in tlie plants. And, of course, you must remember 
that we are a small community of '!2, 000 people. This would not be possible in 
Philadelphia or New York City, But everybody is on a first name basis pretty much. Our 
instructors can call and talk with the supervisors of the varous area plants, ^’/hen a job 
opportunity comes up for a milling machine operator, the instructor Imows Johnny. He 
Imows what Johnny can do and what his limitations might be, and can get come pretty close 
liaison here. 

We have no problems in placement, particularly today, V/e have had as hi^ as 400 
Pennsylvania State Bureau of Rehabilitation clients attending our school for many years. 
Some of these could be New York State rehabs. We have had quite a large number of New 
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York CItate Rehabs and a few from many other States . I really do not feel there is too much 
of a problem In the placement of the older worker provided we can give him training. 

We have had very little experience with the person who is of the hard-core, hard- 
to-reach, hard-to-teach group and who is functionally illiterate. Our work has been 
with those who were trainable, those we could train at least to be a drill press operator 
or a linoleum layer, something along diis line, pattern making, plumbing, weldiug. 

And, of course, in welding, we can go to a welding technician which is a two-year pro- 
gram, or we can stop at 10 weeks and put out an acetylene aircraft welder who simply 
does various types of acetylene welds on aircraft tubing. 

DR. VITELES: Mr. Carl, are you essentially saying, then, that your type of 
program is useful, is practicable, only in the smaller community, perhaps where you, 
indeed, know which jobs are available, where you can deterine with a gr^t deal of 
certainty that a Job will be available after the individual has been trained ; 

DR. CARL: I you are interpreting me too literally here. I am sure it is 
applicable to Philadelphia or New York or any place else. However , we would not get 
down to this first name basis in a larger city , nor could the instructor know super- 
visors in industry as well as he does in a smaller community. Other than that, I would 

think it would be adaptable any place. 

DR. VITELES: Yes, sir. 

DR. R. MEREDITH BELBIN: (Consultant, Organization for Economic Cooperation 
and Development, Paris, France): ’'Selection for Training - Do Present Practices 

MiUiate Against Older Workers^ ” I wonder if it mi^t be worthwhile my havmg a stab at 
this particular question since it is the subject of this workshop. And may I propose to you 
the provocative question that present practices do militate against older workers, 
especially insofar as this GATB is applied under tiie MDTA program. 

It is nearly always the case that where selecti<m tests and batteries are applied, 
older pe<^le are excluded from training situaticms . The more rigorously they are 
applied, the greater the proportion that is exclu^^d. 

Now, perhaps the significant question we ought to ask ourselves is whether older 
people are being excluded from these courses on sound grounds . It might seem fairly 
rational, logically, to exclude people from training courses if their scores shown on 
certain selection tests are low. But we have had a fair bit of ejq)erience in England at 
examing the relationship between job performance and scores on a very wide battery of 
tests. And I have never ceased to be astonished at the very poor correlations that do 

exist. 
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To take a seemingly clear-cut case, that of designers in thete:ctile industry. I 
don’t know what sort of .^.bilities you might imagine are necessary for the job of a 
textile designer, but one might suppose that one essential requirement was that the person 
should not be color-blind. And so the placement council applied a color-vision test for 
designers and proceeded to validate this on designers already in the industry. They came 
up with the astonishing result that some of the most successful designers showed color- 
vision defects — quite serious color -vision defects. 

And one of the things that seems to crop up so frequently in this field is that 
people obtain poor scores on certain types of performance tests, and yet they compensate 
for this in other ways, and that when trainees are hi^ly motivated towards learning or 
motivated toward jobs, their ultimate performances are very much hi^er than might be 
predicted from selection tests. 

So, with all this, I am wondering what our starting point should really be, what 
sort of value we should place on selection tests as far as the acceptance of older workers 
into training programs is concerned. And I would very much like to hear the views of the 
speakers on the subject. I would like to hear some sort of h3q)otheses put forward. 

I think everyone so far has been frightfully circumspect md .cautious about what 
they have said about selection tests. I would like to see some hypotheses put forward 
about the area where they think the most value is going to lie in the future in the admin- 
istration of these tests. 

DR. VITELES: In other words, so far as a practical recommendation is concerned, 
you would like to consider the possibil ity of making the recommendation that selection tests 
should be discarded ? 

I am not phrasing this as my hypothesis. I will if you want me to, but essentially, 
this is what you want us to consider ? 

DR. BELBIN: That’s putting it very strongly. 

DR. VITELES: Naturally. 

DR. BELBIN: I would like to say that I think our starting pomt should be one of 
skepticism until the necessary work of validation has been carried out. 

Now, in the General Post Office that I mentioned to you this morning, I referred to 
the fact that the Civil Service Commission administered a battery of selection tests on 
postmen. A similar battery is also applied to telephonists.. Aid in one experiment, we 
selected groups of people who would have failed on the previous scores. There was a 
group of telephonists and a group of postal sorters. Each group was put through the 
normal training procedui*es. And these two groups showed, at the conclusion of training, 
performance scores not inferior to those who had passed the tests. And I think there is 
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perhaps a good case for saying tiiat the relevance of se.ection tests depends on the efficacy 
of training methods. The better the training methods, the less important it is to have 
selection tests, the object of which is to exclude people from training. 

I would like to have that as the speaker's propotied starting point. 

DR. PALLONE: I would like to make one comnaent, but really to ask Dr. J)roege to 
describe current procedures for determining minimally qualifying scores for MjjTA 
trainees. 

As I understand it, we were faced with a peculiai’ situation locally of having a 95 G 
score or an ideal 95, qualifying for enrollme;nt. 

DR. VITELES: Dr. Pallone, I would like to m ake a comment. 

I am going to rule you out of order. I don't thinl: we ought to get into the discussion 
of specific scores for selection for a given job. I think we only have an hour and a quarter 
in which to discuss the basic principles. We ought to devote ourselves to that. 

DR. PALLONE: Let me rephrase it, then. 

As I understand the process, it is quite possible for certain selection scores to be 
established on statistical grounds in the State of Indiana and other scores to obtam in 
Illinois and still other scores to obtain in California for the same occupation. And I wou 
like to pass it along to Dr. Droege now and ask him to describe that process. 

MR. DROEGE: We have 36 State Employment Services that get special tods for test 
research to do just this kind of thing, to develop aptitude test norms for specific occupations. 

and MDTA training courses. 

Now, if Indiana does a study on a part icul ar occupation — 1 et' s say machine 
operator — it does research in accordance with the procedures that we have devel^e for 
these studies and sends in the data to us in tlie National Office. And, let s itwis 

does another study on the same occupation. We take a look at both studies, and we see to 
what extent we cfin develop a set of test norms on one sample that wi cross y i a e on 
the other. In some cases, this i s possible; in other cases it is not. When it is not 
possible, what we do is to see whether we can come up with a single test battery, base on 
data from the tv^o samples, to give us a good prediction on both samples. We can’t claim 
any cross-validation here. In some cases a State v/ili make a case that, because a es 
batt ery was developed in a particular plant or training course, that test battery shoul^ 
used in that toation rather than a test battery based on data from different locations. This 
is based on the concept of the norms being more valid in the location where they were 

developed than in other locations. 

DR. VITELES: In other words, there can be differences among local norms with 
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respect to predictability of the test. Is that it? 

MR. DROEGE: Right. 

DR, VITELES: Based in part possibly upon local differences in the construction and 
the organization of the trade and the operation ? 

MR. DROEGE: Right. 

DR, PALLONE: Or Just the occupation structure. 

DR, ELVIN RASOF (Curriculum Consultant, MDTA, Detroit Public Schools and 
Wayne State University, Detroit, Mich.) : We are one of the la^^e MDTA basic multi- 
occupational programs. Have you gentlemen heard of ”basic education" and the fact there 
is no threshold that one must pass to get into an MDTA program this way ? That you can 
take in people who don’ t reach these particular levels ? In fact, 20 per cent of our 
population are complete illiterates. (And this doesn’t mean computer operators.) But, 

Mr. Chairman, I walked in a little late so I might have missed something when you were 
drawing your guidelines. I am a little disturbed when we speak in the same breath about the 
community college and the 30, 000 people we determined are illiterates in Detroit. 
Community college — this is another world altogether, 

DR, VITELES: This is 30 per cent of your older workers who need retraining? 

HR, RASOF : Thirty thousand in Detroit are considered hard-core unemployed. We 
trained 1100 last year. Of this 1100, 37 per cent were over 45. This will be part of my 
presentation tomorrow, and I don’ t want to give it all away. But I w>uld lil^e to tell you 
we had some success with basic education leading into the MDTA program, (what is called 
the multioccupation basic education combination). And I would like to s^y we have found 
that these people do do very good v/ork. 

We have developed a Job-seeking clinic within our program. 7/e tal^e the man before 
he is ready to leave, even if he alroady has a job, and try to sharpen up for example the 
test taking skills. It doesn’t mean we give him tests day after day, but try to give him some 
kind of testing to prepare him for the outside world. 

And I would like to make a recommendation that there are some Job-seeking skills 
that can be sharpened in almost every project, 

DR, VITELES: You are suggesting, then, that one practical recommendation mi^t 
be that steps be talcen to sharpen up the Job-seeldng skills which include the sharpening up 
of the capacity to take — 

MR, RASOF: — a test. Some of these people have never taken a tegt. And, 
incidentally, this should be close to tlie end of the course, not at the beginning. 
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DR. VITELES: All right. 

MR. WILLIAM TASH: ( Project Director, OMPER Follow-up Studies Caftollc 
University, Washington, D.C.) : Ihe staff at the Bureau of Socid Researc^ Catholic 

University, are engaged in some follow-up studies for the U. S. La to ^ 

Washington, D.C. on five or six E & D projects. I would suggest tl^at ^a^er thm 
ellminallng research procedures, we attempt to do more research ® 
to correlate the results from non-verbal tests, as suggested by to. Car , 

GATE test. We could then compare an older person- s score m the “““X^Xhe ‘on^ 
score on the GATE verbal test. More effort is needed to correlate the two - the non 

verbal with verbal — as a means to help the older person. 

DR. VITELES: Any further comments ? 

Let us keep to this one topic, the implied recommendation that Mr. Eelbin has made, 
on the chance we will come out with something concrete and constructive here. 

DR CARL* One comment on the community college. It depends on your definition 
ofwhaU^ta^Linacommunitycollege. It can be very diverse. And perhaps we are a 

1 iltl e more diverse. 

MR, RASOF: You mentioned MDTA. And this is separate. 

For exampl e, I didn' t get the exact figure ~ it seemed to be a large figure 
Professor Fahey mentioned. 

I would 1 ike to know two things : 

Ctae, how do you know if the job a man gets is related to his irahung or not ? 

'too, how can one define a related versus a non -related job ? 

I would also lilte to Imow the figures of tliese related jobs for MDTA people. 

I would like to know if this data is available. And, if not, why isn't it available 
because this is pretty important. 

What is the most important thing - to get this man out working or to get him on a 
related job ? 

And also, let me say ftat we in our program had a two-week trial basis where the 
people could try out different areas. We found that many of our illiterate 
came in would sit near some man who might say, "I am going to sign up for cookmg. ^ 
this guy signed up for cooking. And there were little clusters such ^ 

it is teLr to counsel a trainee into an area than have him come m and spend two week. 



here and two weeks there and get completely muddied up. 

DR. VITELES: Yes, sir. 

DEL, FAHEY: Ithinlc that we are all on the same general track. And the problem 
is definitely that the older worker is discriminated against. 

I have data from South Bend on a general survey and a specific survey of older 
workers in training, and these workers in training are of significantly higher 
educational attainment than those who are not in training. So obviously those who are 
not in training, who are unemployed to a greater extent than are this better educated 
group, don*t get into it. 

I think that the speech we had this morning by Mr. Belbin in regard to changing 
our methods of training may be very important; that too often these training programs 
rely on verbal skills. Time after time, I had workers who were actually in these 
training programs say the training course was fine, but the book work was terrible. 
They hated the idea of going into books. And I think that those who have low verbal 
attainment should be perhaps put in courses in which the verbal factor is not too im- 
portant and more emphasis i s given to non -textbook type of teaching; and that we can take 
these functional illiterates and put them into a training program where they can get 
something worthvdiile out of it , 

DR. VITELES: Any further commc^nts ? 

MR. SEILER: I was in the GATE program for seven years, and developing GATE 
norms was my primary function, I think that everybody should know that a set of norms 
developed in one St at e on a sampl e of 50 peopl e i s used throu^out the country. In most 
cases, people who are successful on a job are arbitrarily dichotomized into b.i|^ and low 
success groups. As far as '^ross -validation is concerned, at leasi; conservatively, 80 
per cent of the norms are not cross-validated. I think that it should be a recommendation 
of the conference that some change be made in the kind and size of samples tiiat are avail- 
able before a set of norms is used throu^out the country. I would hope that we could come 
out with some sort of recommendation with respect to norms. 

With respect to the question, do these norms work against the older person, I think 
that we need research to prove ttiat they do work against the older person. Nobody has 
presented anything today which has ^o*^en that point. 

If we get off into a discussion on making job placements, we can talk forever and get 
away from our topic today. 

I am assuming that Dr. Carl has experienced a very low dropout rate. Now, if he 
has a low dropout rate., I again assume that it means thathls students have the abilities to 
learn the occupations that they are training in. And if they do have the necessary abilities. 



- 152 - 



I would like to know what the key elements are in selecting these students. 

A student may try different work-samples and decide that he would like to take tr? jning 
in a certain occupation. However, Dr, Carl' s psychologist and other people make the final 
determination. Question to Dr, Carl: Do you know whether or not the applicants actually 
meet certain GATB norma or other norms before you talce them into your training? If you 
don't and if you haven't even explored this area, maybe you can get together with the 
Employment Service and do some meaningful research, 

> DR, CARL: To answer you, lat ne take one person. 

First, we don't follow the GATB scores. Our psychologists do not believe in them 
per se. We have developed our own because we could not find in certain areas good tests 
to measure what we needed to test. 

Here I have a miner, 49 years of age, with a fourth-grade education, married with 
two dependents. He has a cardiac condition. The Beta I ,Q, is 98 which gives him a 40 
percentile, Bennett Mechanical Comprehension 29, 15 percentile, Minnesota Paper Form 
Board, 8; Tool Score 53, slightly above average; Dexterity’ looks like 16; Minim t 1 
clerical, number 63, which would be 7th percentile. Clerical Names, 40, second per- 
centile, WTI-math — and here is where we could not find an acceptable test, we ha,(i to 
develop our own math test — he ranked 4, or second percentile. 

He wears glasses. His visual distance, both eyes, 20 over 33, Right, 20 over 40, 

I Left, 20 over 33, Nearsighted, 13 over 17, Right eye, 13 over 17, Left eye, 13 over 26. 
Clear fair depth, zero. 

Job trials, electric motor winding seven days. He took four. And then he went back 
later for three more days. Sign painting one day, carpentry one day, office machine 
servicing of typewriters two days. 

He wound up in electric motor winding and repair, I didn't see anything in these 
tests which indicated that electric motor winding and repair was the thing this young man 
should have gotten into in the first place. It clearly developed from job trials from the 
areas where the tests indicated to us that he had the basic minimal aptitude to succeed in 
that kind of work, with the dexterity and the tool dexterity and so forth. 

Naturally, he could read and write. He wasn't down this far . 

We accept any applicant that anybody sends to us — the State Bureau of Rehabilitation 
and others — and try to work from there, 

DR, BELBIN: I am very interested in Dr. Carl' s point which I tliink is a very 
significant one. And it closely parallels our own experiences in England. 
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We have got a certain proj cct, currenUy in operation, for research in the problems 
of industrial retraining. And we found such remarkably poor correlations between per- 
formance on many selection tests, that seemed logically related to particular jobs, and 
ultimate job performance after training that we had to rethink the whole problem o 
selection afresh. Reviewing the overall results, we have found that a better predictor o 
ultimate success was good performance at a very early stage, during training or e 

specific job. 

And, therefore, what we have done is develop a hypothesis that the important thing 
in selection procedures is not to measure performance on a particul^ selection s w iic , 
after all, is only going to give a measure of attainment and abiUty at that specific pom 
time, but to measure learning abiUty over a short period of time pn a particular task m 
which the individual has no previous experience. 

We, therefore, have a project which is taking place at flie present time in the 
government training centers whereby learning tests, related to the job flie “ 

ultimately to perform, are being applied as selection procedures, wifli a mew to seeing if 
Ihese give better predictive value than selection tests themselves. 

I am reluctant to comment prematurely on what the results of tto are ^“*6 
But my impression is that a measure of learning ability to these sitobons lo^s ^ 

it is going to be more promising than the more static picture of performance that em g 

from die application of selection tests. 

DR. VITELES; I am going to try to draw these threads together as we go along* 

It seems to me that what we can agree upon now, without gettiag into too 1°'^ 
argument on the usefalness of tests, is toat this group would discourse toe use of tests 
selecting older people for training which had not been thorou^y validated and cross- 
validated, boih wiih respect to predictabiUly and cutting scores, wiih a s^ple chosen from 
toe population toat is under ccmsideratton, toat is, with whom we have to deal. 

DR. CARL: I don’t know as I would exactly agree with tiiat. 

DR. VITELES: Let me just elaborate on tnis a bit. 

I suspect toat I can cite just as much evidence with respect to toe usefalness and 
long-range predictabiUly of tests as you can cite negative evidence --possibly “°re - 
because I have been to tois field 45 years. And I beUeve toat I can “ 

you can on toe nvmerous instances to which tests have been misused, becTOse of toe faU 
to cross-validate boto the tests and the cutting scores against a respectable criterion and 
on an appropriate population sample. But the fact that tois happens does not mem, m my 
opinion, toat we should discard tests where toey can be useful and where, indee^ perhaps 
toe training as a predictor for selection may not prove usefal for two reasons: One, 
because of toe length of toe training program required to determine future work adjustment 
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is too iong. Two, because of tiie uumber of times in which it has been shown that even 
early training on a task is not necessarily a predictor of later performance on a task. 

However, I think I would be inclined, along with this first recommendation, to suggest 
another — and then 7 think we will be ready to hear from Dr. Carl again namely, that 
more attention be paid to the possibili^ of a good, sound long-enou^ training experience as 
a basis for selecting people for training. 

In spite of my frequent and quite successful use of tests in many instances, I still 
contend that the best predictor of future performance is the past behavior of die individual. 
The only reason we can’t use this fully is because we do not have enou^ opportunities to 
observe the individual under standard conditions for a long enou^ time. And we do not 
even have the techniques for recording such observations. 

But a training program on the job itself provides an ideal situation for observing the 
behavior of the individual and, from that, predicting future success on the job. And there 
is a considerable amount of e^erience, including my own experience in transferring people 
from gas plants to electric plants, in selecting and tr ainin g programmers in the modem 
situation, that indicates there is a good deal of merit in this as one of the many approaches 
that can be taken toward selection for the training of older workers. 

DR. CARL: I would essentially agree with you. However, I think that I would not 
want to stop the use of tests until such time as we validate this thing all the way across the 
board, because we need every assistance we can get to help us in helping the individual get 
to what he wants to do. And even thou^ at times we feel the tests are quite poor 
indicators, if a boy can come up with an 85 percentile in the Minnesota Paper Form Board, 
this does tell us something. And we would want to use it. Whether or not we fiilly validate 
it, the reliability of this particular situation, I wouldn’t worry about this at this time. I 
still want to use the tests that we have today. 

I agree with you we should carry on further research to Imow where we are going in it 

DR. FAHEY: One problem bothers me — I am not a tester, and I don’t reaUy under- 
stand too much about it so you can excuse my ignorance, and I see where they would be 
very useful in putting an individual into a particular type of training program but I thmk 
die big problem we face here with the older worker is getting a person into a training 
program. I think all these people should have an equal opportunity to get into a training 
program and that this selectivity should not be accordii' . to tests. And after you nave 
determined whether or not they are eligible for teaching, whatever criteria you use, 
then you will set up particular kinds of training courses to cover flie wide range of abilities 

that you have. 

Certainly, you couldn’t put an iUiterate in a class that requires reading. But he 
should have something that he can go into. And it shouldn’t have to be Basic Education. 
Many a 55 -year -old man or woman is highly insulted that they have lived all tiiis time 
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v.'ithout reading and they don’t loiow why they have to read now. But is there something 
that they can be trained for ? ^d I think that is the main, problem. 

DR. VITELES: Could you rephrase that in terms of a recommendation that we mi^t 
make? 

DR, FAHEY: I would recommend that older workers be accepted for training without 
regard to test scores. Test scores would only apply where we are putting them in a parti - 
cular training course. 

MR. SEILER: What kind of training are you talking about ? Ail tiie training is 
specific occupational training. 

DR. FAHEY: I thini? training is functionally good for much different reasons than you 
do. I think it is good for its own salce, whedier the person does what he is trained for or 
not, which I think most of you would not agree to. And I give my reasons for that tomorrow . 

MR. DEOEGE: I would lil:e to come back to Dr. CarPs comment and Dr. Viteles* 
points about the cross-validation. 

It seems to me that althou^ cross-validation is certainly an ideal that we should 
shoot for, to require it before tiie tests are used operationally — and I don*t mean 
necessarily in strai^t selection; I mean counseling too — is not entirely realistic ^ v/e 
don't require cross-validation of other informatior. about the individual for determ ing 
whether he v uld meet the qualifications for a particular training course or job. \/e use 
what information we thinly is relevant based on vdiatever research has been done. 

I think cross-validation is good, and v/e ou^t to do as much as we can to get tius 
kind of evidence. But to insist that it be obtained, I thinly is not realistic, 

DR. VITELES: I just want to say one word on that, but we will have to have a vote 
on these issues before we go, I was a member of the original board that set up the 
Occupational Analysis Section of the U. S. Employment Service, My great fight all along 
with that board and the people who followed in the Employment Service was the failure to 
talce the time to do the cross-validation. And we are pajdng for this failure ri^t now 
because we have instruments, and we do not know the real worth of these mstruments in 
particular situations. 

So if the group as a whole votes against this cross-validation, I want to go on record 
as stHl saying this is absolutely required. 

Go aliead. 

DR, PALLONE: I just wanted to comment on Dr. Fahey’s and Dr, Droege's 
statements. 
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This isn't applicable necessarily only to the use of the GATB or any otiier aptitude 
battery with an older worker population, but I tiiink with any population. I think one of the 
difficulties has been that in only rare instances are the critical aptitudes necessary for 
success in a specific occupation, as opposed to the general aptitudes necessary for general 
occupational success, the ability to apply the procedure in doing whatever task is under 
consideration, not a specific task, but any task. 

It seems to me that when there are areas of overlap, such that there is a range of 
acceptability, verbal ability, among screw machine operators and refrigeration mechanics, 
then we have not yet parceled out or factored out the critical aptitudes that are necessary 
for success in those two occupations. 

And I think that this is one area that we have to go into in test development, to make 
tests more tm^opriate as selection devices across the board, let alone for older 
workers. 

MR. TASK: I propose a recommendation along the lines of action. 

If we de -emphasize testing, and place more emphasis on a person's past behavior, 
there is a greater need for selecting hi^ly qualified vocational counsellors. 

I recall that two projects we evaluated standarized tests were not used, ^t the 
people who were employed as counselors were not qualified to make good subjective 
counseling appraisals. They had little past experience. Unquestionably it is difficult to 
get people who are qualified to make this type of appraisal. We were convinced that a test 
even if not completely adequate, was still better than what such counselors were able to 

accomplish. 

So I would suggest that if we de -emphasize a standardrsed test, there should be a 
greater urgency to see that qualified people are employed for this assessment process. 

DR. VITELES: Any comments, further discussion of this idea ? 

MR. PARKER ROBINSON; (Chief Supervisor, Massachusetts Division of Employment 
Securiiy) : 

I couldn't agree more with what Mr. Tash said. And I intended to bring that point up. 

I think most of the Employment Service agencies throughout the country, and I 
believe Mr, Mau^an would support me in this, because of the tremendous challenges we 
have had in the past few years witii all of these programs under the Great Society, lack a 
sufficient number of professionally trained persons who have the judgment of persons such 
as a couple of our distinguished panel members. 

Oftentimes, a person who is personally responsible at the local Employment Service 
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office for the selection of a candidate for MDTA, — whether he be an older worker or a 
youth ^ may have only been on that position less than a year. Fe may have only been in 
the agency less than a year. And even those who have had a considerable length of service 
with an j^ency may not have had the particular type of experience and training to fully 
qualify them for the judgment necessary to select the properly qualified person. And I 
certainly would oppose the abandonment of tests at this time unless we are absolutely 
sure we could secure a sufficient number of hi^ly trained, competent people at the 
local level for this position. 

MR. VI TELES: May I malce a comment on this? 

There has been a Mnd of renaissance of interest in the literature in interviewing 
and in the validity and reliability of the interview. More anc more articles are 
appearing on this issue. And they again show that the extent of agreement among in- 
dependent observers in the assessment of an individual is frequently small. Luthere 
the U.S. Empl03nnent Service demonstrated many years ago, m the case of training job 
analysts, that hy properly designing the training program, you could come out wi th a 
corps of job analysts who would come up wi th pretty much the same evaluation of the 
job, with the same ratings on the various characteristics. And J think that it is very 
well that at this point we have recognized the need for consistent traini ng of anybody who 
is going to be involved in the selection process, in order to achieve maximum results 
in the use of the interview. That might well be one of the principles that we formulate 

here. 



I cut you off. Dr. Bel bin. 

DR. BELBIN: I am frightened that we are going to conclude that we should 
abandon our selection tests. I don’t think I have heard anyliody propose this. I 
certainly haven’t proposed it myself. All I have done is draw attention to the fact 
that many selection tests that appear to logically relate to job performance, in fact, 
when v/e consider their results against ultimate job performance, give disappointing 

correlations. 

What I would, therefore, like to propose with regard to this is not that 
selection tests be abandoned, not at all , because we want to develop our loiowledge 
about selection tests — this is one of the objects of the endeavor — but that selection 
should be used to guide placement as between different training courses as far as 
possible, and that we should not Ihink of selection tests as the agency for excluding 
people from training altogether. 

I think thi s i s the point that Professor Fahey was bringing out. I think it is 
in practice the significant point, as far as the application of this GATE test is 
conderned i n the general employment, f i el d. 

In fact, I think we should exclude tests from training courses altogether, wiiere 
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they are used as the basis for exclusion unless they have been validated. 

DR. VITELES: And cross -validated. 

DR. BELBIN: Cross-validated. 

DR. VITELES: Any further ? 

MR. JOHN KOENIG: (Director, Manpower Training, Stat e Department of 
Education, Tenton, N. J.): I agree with the statements that have been made so far. I 
am in agreement that we shouldn’t abandon the tests, obviously, and that we should work 
toward the cross-validation of the tests. But I concur with the gentleman from South 
Bend in that if we use the test, and tests can be used as a discriminating factor, some 
of the older people may not even be admitted to the program. This I think, is one of 
the serious problems here. 

In New Jersey we are moving toward multi -skills centers, very similar to many 
that have been set up in the country. We have three in op^ation, two more to open 
soon and two more in development. We will have seven or eight skills centers, hoping 
that we can cope with what you are talking about . 

We have an agreement worked out now with the Employment Service whereby 
referals come in unclassified. They have not been given tests — in certain cases, not 
even at the Employment Center — for the simple reason that some of these people 
have never talten a test . If the trainee, i s a youth, some have vivid memories of recent 
tests flunked in school . Many are scared of tests. This factor alone would invalidate 
the tests to start with. 

We do not give tests to the trainee the first day he or she arrives at the Sldlls 
Center, nor do we start them in Basic Education the first day. Trainees are permittee 
to survey the operations that are available. Very similar, apparently, to what Dr. 
Carl suggested, to stir up an interest. 

All of our jobs are set up in clusters, such as clerical skills, and food services 
as opposed to cook, typist, or file clerk, classifications. 

For example — clerical skills* Everyone starts as a file clerk, because even 
if they are going to be a stenographer, they should know something about filing. From 
this point, everyone progresses at his own rate. Trainees in the same class will be 
graduated as file clerks, some as clerk typists, others as stenograjdiers. Abilities 
deter ime occupational attainment within the clerical skills cluster. 

I think the other point, as far as action goes in all of these skills that we are 
setting up, is that we have advisory committees from industry for each occupation. For 
instaice, talce our short program for bank clerks. Personnel from banking industry 
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advise us on the curriculum. Tliey also talk to our students. Nothing seems to motivate 
our students more than having employers come in and say, "We have X number of 
openings for bank clerks. " 

They also talk about the importance of personal grooming, personal adjustment, 
and punctuality. I would like to recommend that we not rale the tests out, getting back 
to tests, but at the same time, I don't think it should be the all-important e erm g 
factor as to whether a trainee he should be admitted into the program in the first place. 



MR DPOEGE: Let me j ust malce a comment in clarification as to what the 
Employment Service policy is on use of tests with the disadvantaged, and the difference 
between policy and practice. The recommended procedure here is that if the person is 
considered disadvantaged in any way, he is referred to a counselor who looks at this 
individual, not from the point of view of screening him in or out of a ^ 

from the point of view of considering what are the alternatives for this Individual. A 
number of training courses may be available. There may be a possibility for direct 
placement. All of these should be considered. Wi th regard to the use of aptitude tests, 
the idea is that, if the individual does not have the basic literacy skills to take tests tiiat 
require such skills, he is not to be tested with these but only with tests not requiring 

literacy skills. 



Now, the practice is not always in 1 ine with policy — leading to the criticism we 
hear discussed now, that the tests are, in fact, in many instances used for screening in or 
out of a particular training course. 



DR. VITELES: Yes. 

MR. MILTON ROSENBERG: (Director of Employment, New York State Commission 
for Human Rights, New York City) : There is one point I haven’ t heard mentioned at all. 
The entire emphasis is on manpower training programs under some form of government 
supervision or assistance. 

Now, what I am concerned with is: what about the point that present ^actices 
militating against the older worker may include the fact that there is a sp^ecific age 
barrier before you are even eligible for consideration for a training program in priva e 
industry, at least, and even in some governmental situations ? Talte the building con- 
struction industry where the apprenticeship rules are very c’ear, 17 to 26; tal<e other 
situations where private industry will say, "We are considering people only up to s^e 28, 
for a certain training program. And these are not only those training programs where 
there is a three, - four - or five-year period, but even training programs of a year or o. 

That's the first part of my question. What is being done in connection with ans^vering 
the question as to how valid are the specific age barriers set fortli without reference to 
anything except your eligibility to come in and be considered ? 
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As I understand yvour comments this morning, Doctor, you suggested there were ^ 
some areas in which lea^l^ing ability stopped even as early as 18 or 19. And so, in the 20's, 
there was a clear diminution of ability. 

I don’ t Imow who would answer that question for me, I assume Dr, Droege or the 
moderator. 

DR. CARL: May I comment? In 1945, we started a course in heavy construction 
equipment, operation and maintenance. Boys, to get jobs, had to go non-union vrark 
non- un ion for a couple of years, and then they could join the union. It depends on w at we 
are talking about. The communities and the labor programs vary. We have a lot of ^n- 
union construction in our area. In other larger cities, cf course, they would be pretty 
well ti^tened down to strictly union situations, 

I have had large typewriter companies and office appliance equipment companies say, 
’’Give us anybody up to 55 years of age. We would like to have them by 55 because, then, 
with ten years with us, tiiey can come out at least with a fair partial retirement situa^n. 
Above that, we can't very well have them come out with such a retirement, on in^ 
we have too many problems in this respect, Tliere are some, and we have to wor c aroun 
them just as when we train a wheelchair case in drafting. We have to look for that 
particular plant that has a drafting room on the first floor so that we can put a itt e ramp 
to get up the one step to get the draftsman to work, V^^ereas, if the drafting 
the third floor and no elevator, we certainly can’t put that draftsman to wor t in a p an . 

MR. ROSENBERG: That isn’ t my question. My question specifically ?s: Is tliere 

any validity to a specific age barrier to the acceptance for consideration of an applicant 
for a training program ai:d, if so, what research is being done on th^s subject r 

I am not talking about bona fide occupational qualifications, v/here a man caiVt do -t, 
or a five-year training program for a man vdio is aged 60* I am tal king about ® 
statement by a private industry that if you want to apply for a particular job w ic mvo ves 
a preliminary on-the-job training program or an in-service training program or ^ 
construction ^prenticeship program, you may not be over age so and so, m e you 

all Imow what I am talking about. Now, is there any research which says yes or no to the 

validity of that particular criterion ? 

MR. DROEGE; Well, for one thing, there have been some surveys by the National 
Association of Manufacturers and others asking employers what per cent of the people 
aged 45 and older are satisfactory as opposed to the per cent below that age, this sort of 
thing. This is pretty subjective, doesn’t really get down to the problem, and it generally 
doesn’t get down to specific jobs. But there have been some studies by the Bureau of 
Labor Statistics, using productivity indices, where they go into a plant and relate pro- 
ductivity to age. One shoe manufacturing plant, wh^re there was a wide distribution of 
age among the employees was studied in this way. And there have been a number of ot ers 
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The trouble with studies of this kind is that they are cross-sectional in nature. They 
get whoever happens to be in the plant. There are reasons why such samples might not be 
the kind you need to malce valid conclusions. One, perhaps the most basic, is that a number 
of people have been promoted because they are very good workers, and others, who have 
not been successful, have been fi'^ id or have gone into other kinds of work, leaving a group 
that cannot be defined well. What you need in this area are longitudinal type studies where 
individuals in a wide age range are hired without any regard to age or test performance, 
and then followed up to get indexes of productivity or taining success and then relate age to 
these indices. But it is very difficult to get data of tiiese kind and I Imow of very few 
studies of this type that have been done. 

DR. VITELE3: May i say a word on that ? 

The whole matter of studying age effects is very, very complicated largely because of 
cultural factors which affect the performance of the aged. But throughout tlie years, 
starting with Thorndike* s studies in the *30* s, the Welford studies and even the facte that 
were brought before us today tend to indicate that the loss of capacity with age, the loss of 
sheer capacity, is not as great as people are led to believe. IVhat happens is that there is 
change or loss in motivation; there is a change in learning set; there is a loss of the habit 
of ccxitinuing to learn, which grossly affects tlie learning of older people. But such losses 
as occur are of a nature which, in my opinion, can. be overcome by the development of 
motivational devices, by the development of techniques for restoring learning set, and by 
doingmany of these other things that can be done to overcome that lowering of ability which 
is not due to some inherent deterioration in the individual. 

f 

Now, I think industry is aware of this. And I am convinced that industry *s refusal 
to hire older people is not primarily motivated by a belief that the older person is not 
capable of learning, especially if the industry is willing to spend a little more time on the 
training. But it is most frequently an expression of the pension problem, of the need for 
providing a pension \mder conditions that malce it impossible to do so. 

VTow, to discuss this involves a consideration of economic and many otlier factors 
which I don*t think it is our privilege to discuss. But I think there can be a clear separa- 
tion. I thinlc this can be identified as at least one of the major factor in industry*s 
antagonism toward the hiring of older people. 

And at least I am prepared to say, with a great deal of confidence, that there is 
much more learning capacity in older people than we have used in tlie past. And perhaps 
one of the best illustrations is a series of studies made duiing the depression when it 
turned out that the production of older people started to rise and continued to rise to the 
point where it was above that of middle-aged — and even younger — people, one reason 
for this being that they saw themselves as more subject to fix*?ng at aii earlier date unless 
this was accomplished. 

ITow, what the costs were in the way of accelerated physiological change, we don't 




f 



- 162 - 



laiow. I suspect tliey weren’t serious physiological costs. But, nevertheless, from my 
point of view, what evidence we have on the effects of loss of learning ability, loss of 
capacity, etc. , indicates that this is not tlie basic problem at age 40 or 45. 

MR. ROSENBERG: You see. Doctor, you have dropped the age limit in your 
definition of the frame of reference. We should discuss to 35 for women. 

DR. VITELES; I am willing to settle for age 45 for men. As stated earlier, 
problems are of a somewhat different nature in the case of women. 

MR. ROSENBERG: So we are not talking, really, about older aging people. We are 
talking about a strictly middle-aged group now which is a different frame. 

DR. VITELES: I think the situation for women is different. They are mostly in the 
office Jobs. And there the prejudice tal^es the form of a sheer desire to have younger 
people around. I am afraid this is the case. And, in fact, if I may say this off the record. 

(Discussion off the record. ) 

DR. CARL: I think the law of supply and demand in our economic system and where 
we are has an awful lot to do with this at this particular point. 



Now, we don’t have the problems of the placement of the older worker that we had a 
few years ago. This varies according to economic conditions in the country and die 
occupational area we are talking about. 

MR. RASOF: In our particular c%, we have for example the Negro womaii aged 35 
u*om no one wants. There is no place to train her, really. Sewing, furniture u^olstery, 
automobile ui*olstery and things IBce this. You can't get these people clerical jobs for 
they are people operating at third- and fourfli-gtade level. This one case is a very great 

’’sore” in MDTA training. 

In fact, I wish we could focus just upon this one segment of the population. We 
would like to see funds set aside just to focus on segments such as tins one. 

And remember, this woman also has family of some kind to support. 

And if you look through the papers, you see there are many ads for domestic. We 
say, ’’Let’s not put them mto domestic. ” And yet there is an area where people want to 

hire this group. We say, ’’Don’t go there. ” 

MR. ROSENBERG: There is another point before you sum up which bothers me in 
connection with the principles which we are now considering. 



First, there seems to be quite complete agreement that we should have as much 
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validation as possible. What I ^vant to know is what you do in the process in the period 
of time i!\^ch elapses from the time that you are experiementing, on verbal tests, for 
example, and the time you validate them. 

I mean, what we are faced with in the large ur!!7an centers such as Detroit and 
New Yoric City is the problem of moving very large groups of people, who do not have the 
capacity to take verbal tests, into training and then to jobs. 

And what occurs at a community college, I would agree, however defined, means 
that you at least have a certain degree of literacy and have certain verbal and aridimetic 
skills. 

So that the question which I think mu_st be included among the recommendations of 
panel is what you are going to do In tlm interim between the development or ex- 
perimentation with new t^ts and their validation and cross-validation and what do you do 
with people who at this point are non-test-takers in the sense of their ability to face up to 
any l^d of a test. 

And 1 would certainly suggest that that be considered in the final results of the 
panePs recommendations today; that this question not be left unaswered. 

I don't propose to answer it except on the basis of accepting a certain number of 
unclassiDed people and using Dr. Droege's empirical suggestion tttat yon just don't wait 
fmm you validate everything and find out how it works in practice in the Interim. 

PROFESSOR RAMONA FIRST (Professor of Economics, San Francisco State 
College, San Francisco, California): Wo are working to serve persons 60 years of age 
and over. I would like to suggest that one of the guides to wcoinlng would have to be 
past work history, as was mentioned briefly earlier. This is the only guide we have for 
our group, and we think it is going to be useful. 

DR, VITELES: And this is more frequently available in the case of individuals 45 
years of age and over than in the case of a younger population with whom we are con- 
cerned in another context. 

PROFESSOR FIEtST: We feel that the current Employment Service interview is 
not long enou|^ or detailed enough to bring out the picture of the person's past attachment 
to his job and fee abili^ to grow in it which mi^t bo a clue to training potential. 

DR. VITELES: I wonder whether I could point up this discussion just through the 
use of four concepts that have been recently introduced in the consideration of decisicm- 
making on personnel selection. 

There are the concepts of fideUly and widfe, taken, of course, from the electronic 
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industry. You can emphasize fidelity or width, and it is very difficult to get both together. 
And this is one of the distinctions between AM and M broadcasting. 

Then, we have utility and cost. 

Now, the advantage of a well -validated selection battery is that you have high 
fidelity. You get high utility at low cost. 

MR. RASOF: Where is the width ? Is that without any width ? 

DR. VITELES: Let me talk about width a moment. 

In the extension of width, you get some return. Talce the interview which includes 
some discussion of the biographical background of the individual. We don’t have many 
objective findings that support the use of this kind of device m terms of fidelity. But the 
sum of experience has been that something comes out of these interviews some vu lu 

added to our bases of assessment. But the cost is high in two respects. It a 
costly m.etliod of assessment. And tliere is a hi^er cost to the industry and proba y o 
society at large because of the mistalces that are made. 

Now, it seems to me if we wanted to summarize in one broad statement what has 
been said here, it is that for practical reasons, especially in tlie absence of techniques 
that have hi^ fidelity in tlie assessment of certain characteristics, we must con inue o 
use davices which are wide in the sense of not producing good prediction, ^e recogxiize 
that the cost is h. h and that we may even have to go so far as to ask industry ^ 
government to bear some of this cost m terms of trying out some people wiom ey 
wouldn* t otherwise have tried out. 

Eat, nevertheless, we are also saying, I think, that we must do die research teat is 
required to produce instruments and techniques of all kinds with high fidelity since 
are tee ones teat will give tee best results from tee point of view of industry, from tee 
point of view of tlie community, from the point of view of tee individu imse^ 

Is that a fair summation of points of view teat have been expressed here . 

All right. We have ten more minutes. 

Do you want to consider these recommendations one by one and vote on them, or do 
you want to continue with tee discussion ? 

All right, let* s see whether I can plirase, in probably a biased way, the re- 
commendations which seem to grow out of this discussion. 



One is that the use of tests should not be discontinued, but teat tee wealoiesses 
should be fully recognized. 
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Will you accept that ? 

< There was general agreenoent.) 

Secondly, from the point of view of the long-raiig^ program that every effort be made 
to assure the highest degree of valuation and cross-validation of tests, incln^ing pre- 
dic^abilyt and cutting scores, too, as a prerequisite for their intensive use. 

Will you accept that ? 

( There was general agreement. ) 

The third is to recognize the potential of a training period as £u alternative and in 
somo instances even a better predictor of success in the occupation tha:i tests themselves 
and that the use of such device, altliou^ costly, is necessitated by the present situation. 

Any objection to that ? 

(No objection.) 

The fourth recommendation which I seem to hear, and I thou^t this was a good one, 
aldiou^ it wasn't discussed at length, was that in dealing with these older people, talce 
a kind of a job family approach. This concept of job family, a multi-job approach, an 
area of job which was, of course, developed again in the U. S, Employment Service 
program, as a way of kind of selecting for each individual the level at uAich he can best 
serve thereby providing an opportunity to place low-level people at low-level jobs, moving 
the higher level people up to ki^er level jobs. 

Does this kind of say what you want to say and v^at you were sajang ? 

TR. BELEE'T: Yes. 

I.'IR, SEILER: How do tests enter that? 

DR. VITELES: This can be done either through test'ng or training, or bofii. 

Actually, the General Aptitude Test Eattery in theory attempts to do this. It attempts 
to set levels. And it also to some extent can ta’:e care of the compensation factor, because 
using a total score on a differential aptitude test, an individual can score very low in 
certain parts of tiie battery and still get a satisfactory passing score by scoring higlier in 
other parts of the battery. 

This is one of the very significant features of the multi -aptitude test battery, 
although the shame of the thing is that it tends to reduce the predictability of the finding. 
And this is one of the difficulties that the psychologists have not yet overcome. 



o 



4 
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MR. SEILER; But the current procedure is the multiple cutoff score approach 
where it can’t compensate. 



DR. VITELES: That's right. It is a hurdle procedure. 



MR. SEILER; Right. 



DR. VITELES; And this is wrong. This is why T accept this recommendation. I 
thinly we have made more mistakes by using the hurdle approach, the multiple cut^ score 
than we can possibly excuse ourselves for malcing because the individual who is m 
general intelligence, but low in mer’^anical comprehension, may be able to ^ e a jo in 
spite of the fact that he fails to meet a siiibl© passing score on the mecaanicai compre 
hension iest. And this is why the compensation factor works and in my opinion as no 
been sufficiently used. 

However, I don't Imow whether ftat's for flie recommendation or just for the record. 



FinaUy, it seemed to me I heard one more recommendation that was not pressed to 
any degree, but that more research be done with non-verbal culture-fair tests as a 
substitute for tests presumably hi^ly loaded with qiectfic cultural factors. o you wan 
to include that as a recommendation ? 



We probably oug^it to discuss that. 

In the work that I have done, for example, I find a correlation of .80 betw^n the 
Otis verbal and a test touted as a culture-fair test. Such findings have been duplicates 
elsewhere. So the problem is even broader tlian is apparent on tlie curface. _ut ’ 
to me we should at least do the research that is required toward developing tests which 

are as culture-fair as possible. 



DR. PALLOME: Isn't that a matter ox interpretation relative to tne population 
studied ? 

DR VITELES: There are many factors involved here. I think those of you who are 
interested in this problem - the whole problem of tests - might well read an article 
written by Philip Vernon on ability factors and environmental influenc^, which w^ 
recently published in the American Psychologist, There is another 
cently written by Sir Cyril Burt, the very eminent British psychotogist, which deals th 
the same problem. And since the two come out with somewhat differing conclusions, it 
might be well for you to read both articles if you are interested in an mtensive considera- 
tion of this problem of whether, indeed, it is possible to develop a culture-fair test. 



MR. ROSENBERG: May I ask this indulgence since I come from a Commiss?on 
which has law enforcement powers, in which some of these ideas may come up m some 
pending cases ? May I be noted for the record simply as abstaining from any opmion on 






the recommendations wiiich you have made, since they may come before me, in effect, for 
recommendation in the case of litigation. 

DR. VITELES: Well, all right. Eut, of course, the fact is that we are not 
recording these as unanimous recommendations, j'lst recording them as recommendations. 
I think it would be a mistalce to record tliem as unanimous because I suspect that each one 
of us has some degree of reservation with respect possibly to every one of these re- 
commendations . 

However, if you waiit to be recorded spec if ic all as abstaining, I thinic that should 
be done. 



IvIR. ROSENBERG: Simply because it is a matter of lav/. 

MR. ROBR'ISON: I would lilce to ma3;e a suggestion tliat the initial training period 
which you recommended. Dr. Viteles — 



DR. VITELES: Not I, the panel, the group. 

MR. ROBINSON: — Which the group has under consideration also be coupled with 
a vocational diagnosis of the type that is now used by Dr. Carl in Williamsport, I "fliink 
this is a very sound diii^. I hark back to the early days in Massachusetts when we in- 
itiated our ARA program and went rapidly into training, only to find out, I thinic, that 20 
per cent of the initial trainees failed to pass the physical examination which made them 
acceptable to employers. 

DR. VITELES: I wonder, Dr. Carl, whether you mi^t not want to initiate a re- 
commendation to the effect that there be a greater consider ation of an individually 
oriented approach as contrasted with the job-oriented approach in the placement of 
woikers for training. 



DR. CARL: I would certainly concur in this recommendation that we should have 
something more generally designed towards tlie particular individual ratiier than the job- 
oriented type of situation. I thinjc this has been the feeling nationally with the MDTA. 



I was in the Americaii Vocational Association meeting ■'ii i.Iiami the first of 
December, and part of the training problem being d scussed there was that tliey were 
finding poor results under MDTA because of the job orientation. And I would heartily 
agree and recommend that we include tliis in our policy recommendations; that we 
establish, as best we can in our respective communities and areas, a more personal - 
oriented type of counseling and guidance toward occupations for the particular individual. 



DR. VITELES: Any serious disagreement with this ? 



(No response.) 
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V/ell, we are about at the closing hour. As chairman, I want first of all to 
^x>logize for having talked too much, and cecondly, to thanl^ you all for your participatior. 
and to congratulate you upon what has resulted from it. I think this will furnish the basis 
for very useful guidance for those who are working in this field. 

Thanlc you again. 

We are adjourned. 

(Whereupon, at 4:55 o’clock p.m. , the meeting adjourned.) 
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